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Acquisition  of  services  has  become  an  increasingly  significant  component  of  procurements  in 
the  Department  of  Defense  (DoD).  From  1 992  through  1999,  DoD  procurement  of  services 
increased  from  $39.9  billion  to  $51 .8  billion.  In  1 999,  total  dollars  spent  on  services  equaled  the 
amount  spent  on  supplies/systems.  As  this  trend  is  expected  to  continue,  we  have  a 
responsibility  to  acquire  services  with  the  most  efficient  practices  and  processes. 

Performance-Based  Services  Acquisition  (PBSA)  strategies  strive  to  adopt  the  best  commercial 
practices  and  provide  the  means  to  reach  world-class  commercial  suppliers,  gain  greater 
access  to  technological  innovations,  maximize  competition,  and  obtain  the  best  value  to  achieve 
greater  savings  and  efficiencies.  DoD  has  developed  this  guidebook  as  a  cooperative  effort 
among  the  components  to  help  the  acquisition  team,  and  any  other  stakeholder,  better 
understand  the  basic  principles  of  PBSA  and  better  implement  performance-based 
methodologies  into  services  acquisitions. 

This  guidebook  has  the  following  goals; 

•  to  promote  performance-based  strategies  for  services  acquisitions  throughout  the 
Department  of  Defense; 

•  to  educate  the  acquisition  workforce  and  highlight  the  key  elements  of  performance- 
based  services  acquisition; 

•  to  encourage  innovative  business  practices  within  the  DoD  acquisition  process; 

•  to  promote  use  of  the  commercial  market  place; 

•  to  increase  awareness  that  performance-based  services  acquisitions  require  participation 
from  all  stakeholders  (the  users,  acquisition  workforce  personnel  and  industry)  to  ensure  the 
requirement  is  adequately  satisfied. 

It  is  vital  that  all  stakeholders  understand  the  importance  of  their  role  in  the  PBSA  process. 

This  process  is  comprehensive,  and  must  include  the  user  and  many  different  functional  team 
players  (i.e.,  financial  managers,  legal  advisors,  program  (project)  managers,  contracting 
officers,  and  contract  specialists  (buyers),  etc.).  It  is  essential  that  industry  also  be  a  key 
participant  especially,  but  not  only,  when  the  requirements  are  complex  (to  the  maximum  extent 
practicable). 

As  the  Department  of  Defense  adopts  more  commercial  business  practices,  we  must  also 
transition  to  an  emphasis  on  overall  business  management,  rather  than  a  sole  focus  on  contract 
management.  DoD  is  committed  to  continually  evolving  the  acquisition  workforce  by  providing 
the  necessary  training  and  tools  to  operate  in  this  new  environment.  Efficient  and  effective 
buying  practices,  such  as  PBSA,  will  help  leverage  limited  resources  in  order  to  meet  the  many 
difficult  challenges  the  Department  faces. 
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TOP-LEVEL  GUIDING  PRINCIPLES 


♦  Use  performance-based  methods  to  the  maximum  extent  practicable  for  acquiring 
services. 

♦  Encourage  commercial  contractors  to  conduct  business  with  DoD  by  using  the  comple¬ 
mentary  strategies  of  fixed-price,  performance-based  commercial  service  acquisitions. 

♦  Utilize  a  multifunctional  acquisition  team  to  the  maximum  extent  practicable,  and 
support  it  with  a  knowledge  management  infrastructure. 

♦  Realize  that  early  planning  is  essential  in  determining  requirements  and  assessing 
market  conditions.  Be  sure  to  include  the  user  and  as  many  relevant  acquisition  team 
members  as  possible  in  this  planning. 

♦  Understand  that  Performance-Based  Services  Acquisition  (PBS A)  is  not  a  “one  size 
fits  all”  process;  and,  to  maximize  returns  for  all  stakeholders,  acquisition  strategies 
should  be  tailored  on  the  basis  of  experience,  market  research,  and  risk. 

♦  Strive  to  define  requirements  in  clear,  concise  language.  Focus  on  specific  work 
outcomes  and  ensure  that  they  are  measurable  to  the  fullest  extent. 

♦  Remember  that  templates  are  only  a  partial  solution.  Sample  work  statements  should 
be  individually  tailored  to  the  requirement;  and,  for  more  complex  requirements,  work 
statements  should  be  uniquely  crafted. 

♦  Seek  industry  comment  and  suggestions  regarding  performance  objectives,  standards, 
and  incentives  through  market  research,  public  meetings,  and  draft  solicitations. 

♦  Use  incentives  to  motivate  a  contractor  to  achieve  performance  levels  of  the  highest 
quality  consistent  with  economic  efficiency.  Ensure  that  the  incentives  are  effective 
and  that  they  reflect  value,  both  to  the  government  and  to  the  contractor. 

♦  Focus  on  the  outcome  rather  than  on  the  contractor’s  processes  when  developing  a 
contractor  performance  assessment  (the  process  known  as  “quality  assurance”).  Also, 
concentrate  on  having  insight  into  the  contractor’s  performance,  not  having  oversight. 

♦  Ensure  that  the  periodic  assessment  of  contractor  performance  emphasizes  clear  com¬ 
munication,  encourages  and  maintains  high  standards  of  performance,  and  is  consis¬ 
tent  with  past  performance  assessments. 
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INTRODUCTION 


Policy 

“It  is  the  policy  of  the  Department  of  Defense  that  (in  order  to  maximize  performance,  innova¬ 
tion,  and  competition  —  often  at  a  savings)  performance-based  strategies  for  the  acquisition  of 
services  are  to  be  used  wherever  possible.  [Punctuation  added.]  While  not  all  acquisitions  for 
services  can  be  conducted  in  a  performance-based  manner,  the  vast  majority  can.  Those  cases 
in  which  performance-based  strategies  are  not  employed  should  become  the  exception.  In 
order  to  ensure  that  the  Department  continually  realizes  these  savings  and  performance  gains, 
the  DoD  establishes,  at  a  minimum,  that  50  percent  of  service  acquisitions,  measured  in  both 
dollars  and  actions,  are  to  be  performance-based  by  year  2005.”  — Under  Secretary  of  De¬ 
fense,  Acquisition,  Technology  &  Logistics  (USD  (AT &L)),  April  5,  2000. 

PBSA  Definition 

Performance-Based  Services  Acquisition  (PBSA)  involves  acquisition  strategies,  methods,  and 
techniques  that  describe  and  communicate  measurable  outcomes  rather  than  direct  performance 
processes.  It  is  structured  around  defining  a  service  requirement  in  terms  of  performance  objec¬ 
tives  and  providing  contractors  the  latitude  to  determine  how  to  meet  those  objectives.  Sirnply 
put,  it  is  a  method  for  acquiring  what  is  required  and  placing  the  responsibility  for  how  it  is 
accomplished  on  the  contractor. 

To  be  considered  performance-based,  an  acquisition  should  contain,  at  a  minimum,  the  following 
elements: 

1 .  Performance  Work  Statement — The  Performance  Work  Statement  describes  the  require¬ 
ment  in  terms  of  measurable  outcomes  rather  than  by  means  of  prescriptive  methods. 

2.  Measurable  Performance  Standards  —  To  determine  whether  performance  outcomes 
have  been  met,  measurable  performance  standards  define  what  is  considered  acceptable 
performance. 

3.  Remedies  —  Remedies  are  procedures  that  address  how  to  manage  performance  that  does 
not  meet  performance  standards.  While  not  mandatory,  incentives  should  be  used,  where 
appropriate,  to  encourage  performance  that  will  exceed  performance  standards.  Remedies 
and  incentives  complement  each  other. 

4.  Performance  Assessment  Plan  —  This  plan  describes  how  contractor  performance  will  be 
measured  and  assessed  against  performance  standards.  (Quality  Assurance  Plan  or  Quality 
Assurance  Surveillance  Plan). 
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Objectives  of  PBSA 

By  describing  requirements  in  terms  of  performance  outcomes,  agencies  can  help  achieve  the 
following  objectives: 

Maximize  Performance  —  By  following  its  own  best  practices,  a  contractor  can  deliver  the 
required  service.  Since  the  prime  focus  is  on  the  end  result,  contractors  can  adjust  their  processes, 
as  appropriate,  throughout  the  life  of  the  contract  without  the  burden  of  contract  modifications. 
This  adjustment  may  be  done  as  long  as  the  delivered  service  (outcome)  remains  in  accordance 
with  the  contract.  The  use  of  incentives  further  motivates  contractors  to  furnish  their  best  perfor¬ 
mance. 

Maximize  Competition  and  Innovation  —  Encouraging  innovation  from  the  supplier  base  by 
using  performance  requirements  maximizes  opportunities  for  competitive  alternatives  in  lieu  of 
government-directed  solutions.  Since  PBSA  allows  for  greater  innovation,  it  has  the  potential  to 
attract  a  broader  industry  base. 

Encourage  and  Promote  the  Use  of  Commercial  Services  —  The  vast  majority  of  service  require¬ 
ments  are  commercial  in  nature.  Use  of  Federal  Acquisition  Regulation  (FAR)  Part  1 2  (Aequisition 
of  Commercial  Items)  procedures  provides  great  benefits  by  minimizing  the  reporting  burden  and 
reducing  the  use  of  government-unique  contract  clauses  and  similar  requirements,  which  can  help 
attract  a  broader  industry  base. 

Shift  in  Risk  —  When  contractors  become  responsible  for  achieving  the  objectives  in  the  work 
statement  through  the  use  of  their  own  best  practices  and  processes,  much  of  the  risk  is  shifted  from 
the  government  to  industry.  Agencies  should  consider  this  reality  in  determining  the  appropriate 
acquisition  incentives. 

Achieve  Savings  —  Experienee  in  both  government  and  industry  has  demonstrated  that  use  of 
performance  requirements  results  in  cost  savings. 

PBSA  Team 

The  PBSA  team  should  be  a  customer-focused,  multifunctional  team  that  plans  and  manages 
service  contracts  throughout  the  life  of  the  requirement.  The  requirement  may  be  for  a  single 
function  or  for  multiple  functions.  Estimated  dollar  value  should  not  be  the  sole  determinant  of 
the  amount  of  effort  devoted  to  the  acquisition.  Previously,  it  was  common  for  contracting  and 
other  functional  experts  to  work  independently  in  acquiring  services.  This  practice  should  be  a 
thing  of  the  past.  It  is  essential  that  all  stakeholders  —  users/customers,  acquisition  personnel, 
and  industry  —  be  involved  throughout  the  service  acquisition  life  cycle,  from  the  require¬ 
ments  analysis  phase  through  contract  award  and  administration.  The  duties,  expertise,  and 
contributions  of  each  PBSA  team  member  are  important  to  the  success  of  a  service  acquisition. 
As  noted  below,  many  functional  experts  can  make  up  an  acquisition  team.  (Note:  The  de¬ 
scription  of  their  duties  is  not  all-inclusive.) 
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Customer/User — The  customer/user  is  responsible  for  defining  the  requirement,  including  an 
assessment  of  the  risk  that  the  government  might  assume  when  relying  on  commercial  specifications, 
common  marketplace  performance,  and  quality  standards.  This  individual  also  plays  an  important 
role  in  deciding  what  trade-offs  can  be  made  when  considering  a  commercially  available  service 
to  fulfill  an  agency  requirement. 

Technical  Specialist/Project  Manager/Program  Manager— A?,  the  principal  technical  expert, 
this  person  is  usually  the  most  familiar  with  the  requirement,  best  able  to  identify  potential  technical 
trade-offs,  and  most  capable  of  determining  whether  the  requirement  can  be  met  by  a  commercial 
solution. 

Contracting  Officer/Contract  Specialist— As  the  principal  business  advisor  and  principal  agent 
for  the  government,  this  person  is  responsible  for  developing  the  solicitation,  conducting  the  source 
selection,  and  managing  the  resultant  contract  and  business  arrangement.  This  individual  researches 
contracts  in  the  marketplace  to  identify  general  business  practices  such  as  commercial  terms  and 
conditions,  contract  type,  bid  schedule  break  out,  and  the  use  of  incentives. 

Cost/Price  Analyst — The  cost/price  analyst  analyzes  and  evaluates  financial  price-  and  cost- 
based  data  for  reasonableness,  completeness,  accuracy,  and  affordability.  Alternatively,  some 
agencies  utilize  cost  engineering  personnel  from  within  an  engineering  division  to  conduct 
cost/price  analysis  from  a  technical  standpoint. 

Performance  Assessment  Personnel  (Quality  Assurance  Personnel)  —  Performance  assessment 
personnel  are  known  by  many  names,  such  as  Quality  Assurance  Evaluators  (QAEs),  Contracting 
Officer’s  Representatives  (CORs),  or  Contracting  Officer’s  Technical  Representatives  (COTRs), 
but  their  duties  are  essentially  the  same.  They  serve  as  on-site  technical  managers  who  assess 
contractor  performance  against  contract  performance  standards.  Performance  assessment  personnel 
are  responsible  for  researching  the  marketplace  to  remain  current  with  the  most  efficient  and 
effective  performance  assessment  methods  and  techniques. 

Small  and  Disadvantaged  Business  Utilization  (SADBU)  Specialist  —  The  SADBU  specialist  is 
the  principal  advisor  and  advocate  for  small  business  issues.  Also  serves  as  the  liaison  with  the 
Small  Business  Administration  (SB  A). 

Finance/Budget  Officer  —  The  finance/budget  officer  is  an  advisor  for  fiscal  and  budgetary 
issues. 

Legal  Advisor — This  person  ensures  that  the  commercial  practices  and  terms  and  conditions 
contemplated  are  consistent  with  the  government’s  legal  rights,  duties,  and  responsibilities;  reviews 
documents  for  legal  sufficiency;  and  advises  on  acquisition  strategies  and  contracts. 

Miscellaneous  Others  —  Personnel  from  outside  the  agency  may  be  useful,  depending  on  their 
area  of  expertise.  These  people  include  personnel  from  agencies  such  as  the  Defense  Logistics 
Agency,  the  Defense  Contract  Audit  Agency,  the  Defense  Finance  and  Accounting  Service,  the 
Defense  Contract  Management  Agency,  and  the  Environmental  Protection  Agency,  etc. 
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The  Business  Relationship  with  the  Contractor 

A  positive  relationship  between  the  government  and  the  contractor  is  essential  in  fulfilling  a  perfor¬ 
mance-based  requirement.  The  agency’s  relationship  with  prospective  and  performing  contractors 
should  be  one  that  promotes  a  strong  and  positive  business  alliance  to  achieve  mutually  beneficial 
goals,  such  as  timely  delivery  and  acceptance  of  high-quality  services,  through  the  use  of  efficient 
business  practices.  Those  in  business  relationships  should  seek  to  create  a  cooperative  environment 
to  ensure  effective  communication  between  the  parties,  teamwork,  cooperation,  and  good-faith 
performance.  These  goals  are  important  for  meeting  mission  objectives  and  resolving  conflicts  and 
problems.  Each  party  should  clearly  understand  the  goals,  objectives,  and  needs  of  the  other.  It  is 
essential  that  government  and  industry  personnel  work  together  as  a  team  to  communicate  expecta¬ 
tions,  agree  on  common  goals,  and  identify  and  address  problems  early  in  the  process  to  achieve 
desirable  outcomes. 
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MARKET  RESEARCH 


Introduction 

Market  research  is  the  process  of  collecting  and  analyzing  information  on  commercial  capabilities, 
processes,  pricing,  incentives,  warranties,  and  delivery  and  other  standard  terms  and  conditions. 
This  information  is  needed  in  order  to  determine  the  suitability  of  the  marketplace  for  satisfying  a 
need  or  requirement.  The  ultimate  goal  of  market  research  is  to  help  the  acquisition  team  members 
to  become  informed  consumers .  Information  derived  from  market  research  will  help  the  acquisi¬ 
tion  team  develop  the  optimum  strategy  for  meeting  the  requirement.  This  section  will  focus  on 
market  research  as  it  applies  to  PBSA. 

Benefits  of  Market  Research 

•  Helps  determine  whether  the  service  is  commercially  available. 

•  Helps  the  acquisition  team  understand  what  alternative  solutions  the  marketplace  can  provide. 

•  Provides  insight,  on  occasion,  regarding  potential  price  expectations. 

•  Helps  specify  or  describe  agency  needs. 

•  Serves  as  the  gateway  for  keeping  abreast  of  the  latest  in  technology  and  current  market 
trends. 

•  Assists  in  overall  acquisition  planning. 

Market  Research  and  the  PBSA  Process 

There  is  no  single  stand-alone  step  for  market  research  in  the  PBSA  process.  Market  research  is 
a  continuous  process  that  should  be  revisited  throughout  the  acquisition  life  cycle.  Consider  the 
following: 

Preaward:  Before  any  documents,  such  as  the  performance  work  statement,  are  developed,  market 
research  should  be  conducted  to  obtain  information  about  alternative  solutions  that  may  be  avail¬ 
able  from  the  marketplace  today.  Once  the  requirement  has  been  thoroughly  analyzed  (as  described 
in  the  preceding  section)  market  research  is  also  useful  in  developing,  validating,  and  refining  the 
performance  requirements  summary  for  the  performance  work  statement. 

Postaward:  Some  commercial  market  areas  and  their  practices  are  continually  evolving,  being 
reshaped,  and  responding  to  various  trends  in  the  market,  e.g.,  information  technology.  Therefore, 
market  research  is  useful  after  contract  award  as  it  ensures  that  the  current  acquisition  strategy  or 
business  arrangement  remains  effective  in  terms  of  price,  schedule,  and  technical  excellence. 

Roles  and  Responsibilities  in  Market  Research 

Since  market  research  should  address  both  business  and  technical  considerations  of  a  require¬ 
ment,  it  requires  the  active  participation  of  all  acquisition  team  members  as  appropriate.  These 
considerations  might  include  technical  approaches,  common  quality  controls,  contract  struc¬ 
ture,  and  standard  industry  terms  and  conditions.  Therefore,  when  market  research  is  being 
conducted,  all  members  of  the  acquisition  team  should  participate  in  their  particular  area  of 
expertise. 
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Conducting  Market  Research 

There  are  no  specific  procedures  for  performing  market  research;  it  should  be  tailored  or 
adjusted  to  each  acquisition.  Different  kinds  of  services  may  call  for  different  approaches.  The 
objective  is  to  become  well  informed  about  the  particular  service  industry  that  will  provide  the 
requirement.  Therefore,  the  key  is  to  be  creative,  yet  thorough.  While  the  following  sugges¬ 
tions  are  not  the  only  means  of  accomplishing  market  research,  they  are  worthy  of  your  con¬ 
sideration: 

•  Determine  what  information  is  necessary.  (What  do  I  need  to  know,  and  what  kinds  of  ques¬ 
tions  do  I  need  to  ask  to  obtain  the  desired  information?) 

•  Locate  informational  sources  where  you  might  find  specific  points  of  contact  to  start  market 
research,  such  as  the  Internet,  industry  associations,  trade  journals,  and  sources-sought  synop¬ 
ses.  Develop  sources  of  information  through  group  brainstorming;  it  may  require  more  than 
one  brainstorming  session. 

•  Define  a  list  of  sources  and  eventually  narrow  it  down  to  government  and  industry  contacts 
that  can  provide  specific  information  relevant  to  satisfying  the  requirement.  Appendix  G  sets 
forth  a  list  of  Internet  sites  that  may  assist  the  acquisition  team. 

•  Develop  survey  questions.  By  doing  so,  you  will  be  able  to  consider  and  capture  all  those 
items  requiring  investigation  and  research. 

•  Use  the  survey  questions  as  a  scripted  point  of  reference  for  interviewing  sources.  Set  a  time 
line  and  discuss  your  results  with  the  acquisition  team. 

Sample  Survey  Questions 

•  What  is  the  normal  length  of  a  contract  for  contemplated  services?  Are  there  any  special  terms 
and  conditions? 

•  Which  services  should  be  required  on  site?  Which  services  can  be  provided  off  site? 

•  What  kinds  of  factors  are  used  to  evaluate  service  providers? 

•  What  kinds  of  performance  incentives  are  used? 

•  What  kinds  of  performance  assessment  methods  are  commonly  used? 

•  Who  are  your  frequent  customers?  (Try  to  get  a  point  of  contact.) 

•  Who  owns  or  furnishes  needed  equipment  and  supplies? 

•  What  are  the  common  qualifications  of  the  people  who  are  providing  the  services? 

The  answers  to  these  questions  will  help  you  build  performance  objectives,  performance  standards, 
and  other  elements  in  the  PBSA  process;  or  they  will  at  least  make  you  better  informed.  The  more 
the  acquisition  team  knows  about  the  particular  service  industry,  the  more  likely  the  team  will  be 
able  to  articulate  the  requirement  in  performance-based  terms. 

Keep  in  mind  that  contractors  or  vendors  are  not  required  to  provide  any  information.  Any  infor¬ 
mation  given  is  strictly  voluntary.  As  a  rule,  information  on  standard  commercial  practices  will  not 
be  proprietary.  However,  if  vendors  provide  any  information  that  they  consider  proprietary,  agen¬ 
cies  must  afford  the  same  protection  to  that  information  that  they  afford  to  proprietary  information 
submitted  as  part  of  a  proposal. 
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Tips: 

•  Review  the  results  of  recent  or  previous  market  research.  Consider  results  from  other  agencies 
that  have  acquired  similar  services. 

•  Start  early  and  involve  all  key  players  in  the  acquisition  process. 

•  Contact  knowledgeable  individuals  in  the  government  and  industry.  Discuss  relevant  best 
practices  and  acquisition  strategies. 

•  Obtain  source  listings  (yellow  pages,  Internet  Websites,  etc.). 

•  Review  any  known  government  and  commercial  databases. 

•  Publish  formal  Requests  For  Information  (RFIs)  in  the  Commerce  Business  Daily  (CBD)  or 
in  other  electronic  posting  systems.  However,  keep  in  mind  that  the  CBD  may  not  be  the  best 
mode  for  reaching  those  commercial  companies  that  normally  do  not  do  business  with  the 

government. 

•  Review  vendor  publications/catalogs.  •  ^  u 

•  Host  presolicitation  industry  exchanges  commensurate  with  the  size  and  complexity  of  the 

requirement.  ■  ^  a 

•  Keep  current  with  industry  solutions  in  your  area  of  expertise  by  attending  symposiums,  trade 

shows,  etc. 
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DEVELOPING  A  PERFORMANCE-BASED  WORK  STATEMENT  AND 
ESTABLISHING  MEASURABLE  PERFORMANCE  STANDARDS 


Introduction 

The  key  to  using  performance-based  methodologies  is  describing  requirements  as  outcomes  and 
not  in  terms  of  how  to  accomplish  the  requirement.  Therefore,  a  performance-based  work  state¬ 
ment  must  be  carefully  structured  to  ensure  that  the  requirement  is  articulated  in  this  manner. 
Accordingly,  the  acquisition  team  will  conduct  a  series  of  in-depth  analyses  to  understand  the 
requirement  fully  so  they  can  articulate  the  desired  outcomes. 

Performance  Requirement  Analysis 

Developing  a  performance  work  statement  involves  a  series  of  analysis-oriented  steps  to  help 
identify  and  define  the  requirement.  These  steps  are  listed  below: 

1 .  Define  the  desired  outcomes.  What  must  be  accomplished  to  satisfy  the  requirement? 

To  define  desired  outcomes,  list  what  needs  to  be  accomplished  to  satisfy  the  overall  require- 
ment/rom  a  top-level  perspective.  Using  an  interviewing  or  brainstorming  approach  with  the 
customer  (user)  to  determine  all  dependent  variables  (what,  when,  where,  who,  quantity, 
quality  levels,  etc.)  will  ensure  that  all  unique  requirements  have  been  considered.  For  some 
requirements,  you  may  simply  review  previous  requirements  for  validity  and  accuracy.  Ex¬ 
amples  of  this  approach  follow: 

Custodial  requirement 

•  clean  office  administration  building 

•  clean  office  training  building 

•  clean  office  physics  lab 

Pre-hardware  development 

•  conceptual  design 

•  component  development 

•  design 

•  fabrication 

•  testing 

•  reporting  requirements 

2.  Conduct  an  outcome  analysis  on  the  basis  of  the  desired  outcomes  (defined  in  step  1)  to 
identify  performance  objectives.  What  tasks  must  be  accomplished  to  arrive  at  the  desired 
outcomes? 

An  outcome  analysis  is  the  process  that  identifies  specific  performance  objectives  for  those 
outcomes  defined  in  the  previous  step.  Performance  objectives  are  the  specific  services  that 
are  defined  in  terms  of  the  outcomes,  which  you  want  performed  and  delivered  by  the  con- 
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tractor.  This  step  differs  from  the  previous  step  —  it  goes  into  greater  detail  and  expands  the 
analysis  beyond  the  top-level  perspective.  The  goal  is  to  describe  adequately  what  is  expected 
to  accomplish  the  requirement  (not  how  to  accomplish  it). 

You  should  start  by  segregating  desired  outcomes  into  lower  task  levels  and  linking  those 
tasks  together  into  a  logical  flow  of  activities.  Using  a  tree  diagram  to  outline  each  of  the  basic 
outcomes  (those  top-level  perspectives)  is  recommended  in  order  to  ensure  that  you  have 
considered  all  critical  elements  of  the  requirement.  Appendix  A  shows  a  tree  diagram  that 
illustrates  the  intent  of  this  step. 

Tips: 

•  Keep  in  mind  that  a  performance  objective  (a  need  to  get  into  greater  detail)  may  not  be 
required  for  each  task  specified,  especially  those  tasks  at  the  lower  levels.  The  performance 
objective  of  lower  tasks  may  be  inherent  in  the  higher-level  tasks  and,  thus,  may  be  captured 
at  that  higher  level.  You  should  go  only  as  low  as  needed  to  describe  the  requirement  ad¬ 
equately. 

•  Ensure  that  each  performance  objective  is  necessary  and  carefully  chosen.  Try  not  to  make 
any  performance  objective  unduly  burdensome  or  restrictive.  Restrictive  performance  objec¬ 
tives  are  often  pricey  and  may  result  in  delivery  of  unnecessary  requirements  at  a  high  price. 
However,  if  it  is  absolutely  necessary  in  order  to  meet  the  mission,  proceed  accordingly. 

3.  Conduct  a  performance  analysis  on  the  basis  of  the  performance  objectives  (identified  in  step 
2)  to  identify  the  appropriate  performance  standards  and  Acceptable  Quality  Levels  (AQLs) . 
When  or  how  will  I  know  that  the  outcome  has  been  satisfactorily  achieved,  and  how  much 
deviation  from  the  performance  standard  will  I  allow  the  contractor,  if  any? 

A  performance  analysis  is  a  process  that  identifies  how  a  performance  objective  should  be 
measured  and,  thus,  what  performance  standards,  e.g.,  timeliness  or  quality  levels,  are  appro¬ 
priate  and  reasonable  for  that  particular  performance  objective.  In  this  step,  you  may  also 
identify  AQLs,  also  known  as  thresholds.  Performance  standards  and  AQLs  are  very  impor¬ 
tant  because  they  identify  acceptable  levels  of  performance.  Developing  and  setting  perfor¬ 
mance  standards  and  AQLs  are  judgment  calls,  based  on  the  needs  of  the  mission,  available 
expertise,  and  market  research.  The  members  of  the  acquisition  team  should  work  closely 
with  each  other  when  developing  standards  and  AQLs.  See  Appendix  C  for  examples  of 
performance  standards  and  AQLs. 

AQLs  constitute  a  minimally  acceptable  level  of  performance  and  are  typically  stated  as  a 
percentage  of  required  conformances  (e.g.,  clean  95  percent  of  the  time)  or  as  a  number  of 
permissible  deviations  (e.g.,  one  error  per  x  time  period).  In  developing  AQLs,  you  are 
asking,  “What  minimum  level  of  quality  do  I  need  to  meet  my  mission  needs?”  Keep  in  mind 
that  not  every  performance  standard  may  have  an  AQL.  When  a  performance  standard  does 
not  include  an  AQL,  you  are  stating  that  no  deviations  are  allowed  in  meeting  the  perfor¬ 
mance  outcome  (see  the  tips  below). 
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Tips: 


•  Exercise  care  in  establishing  AQLs  for  performance  standards.  Often,  the  closer  to  100 
percent  perfection  required,  the  higher  the  price.  It  is  also  important  to  ensure  that  perfor¬ 
mance  standards  are  measurable.  Think  carefully  when  establishing  a  100  percent  standard  (or 
not  establishing  deviations)  since  this  threshold  can  directly  affect  the  price.  AQLs  (thresh¬ 
olds)  of  100  percent  can  be  unreasonable  or  unrealistic  for  some  performance  objectives. 
However,  if  the  performance  objective  is  critical  (for  instance,  if  it  covers  a  life-threatening 
matter),  100  percent  is  acceptable.  Conversely,  if  the  AQL  is  set  too  low,  it  could  act  as  a 
disincentive  to  good  contract  performance. 

•  Market  research  may  be  helpful  for  this  area.  It  might  reveal  that  a  particular  service  area  may 
have  specific,  commercially  acceptable  performance  standards  that  are  expressed  in  terms 
other  than  percentages  or  deviations.  It  is  generally  wise  to  use  commercial  standards  unless 
otherwise  inappropriate  for  the  requirement.  You  might  find  it  necessary  to  establish  your  own 
performance  standards.  If  s  a  good  idea  to  employ  industry  input  or  review  of  agency  stan¬ 
dards  to  ensure  that  measures  are  realistic  and  effective.  This  may  be  accomplished  through 
public  meetings,  public  comment  on  proposed  standards,  or  draft  solicitations.  The  contracting 
officer  should  serve  as  a  business  advisor  to  guide  the  team  on  the  use  of  commercial  perfor¬ 
mance  standards. 

Examples  of  Performance  Standards 

•  Response  times,  delivery  times,  timeliness  —  meeting  deadlines  or  due  dates,  adherence  to 
schedule. 

•  Error  rates  —  number  of  mistakes/errors  allowed  in  meeting  the  performance  standard. 

•  Accuracy  rates  —  similar  to  error  rates,  but  most  often  stated  in  terms  of  percentages. 

•  Completion  milestone  rates  —  x-percent  complete  at  a  given  date. 

•  Cost  control  —  keeping  within  the  estimated  cost  or  target  cost.  Applies  in  cost-reimburse¬ 
ment  contract  arrangement. 

Performance  Requirements  Summary 

The  desired  outcomes,  performance  objectives,  performance  standards,  and  AQLs  that  have  been 
developed  through  the  previously  explained  analyses  are  then  documented  in  a  Performance 
Requirements  Summary  (PRS).  (See  Appendix  B  for  a  sample  PRS  matrix.)  The  PRS  will  be  the 
baseline  for  the  performance  work  statement.  PRSs  should  be  brief  and  should  capture  the  salient 
elements  of  the  requirement.  In  the  actual  performance  work  statement,  the  acquisition  team  will 
elaborate  on  and  describe  the  requirement  in  greater  detail.  The  ultimate  goal  is  to  describe  the 
requirement  in  a  way  that  allows  an  offeror  to  fully  understand  what  will  be  necessary  to  accom¬ 
plish  the  requirement.  (Appendix  C  contains  several  samples  of  PRSs.) 

NOTE:  Many  of  the  samples  in  Appendix  C  come  from  various  agencies  and  other  sources. 
Performance  objectives  and  performance  standards  are  sometimes  combined  in  one  tasking 
sentence.  Likewise,  performance  standards  and  AQLs  can  also  be  combined.  There  is  no 
preferred  format.  Agencies  should  ensure  only  that  PRSs  and  performance  work  statements 
fully  communicate  the  expectation  using  the  appropriate  performance-based  service  acquisi¬ 
tion  elements. 


10 


Performance  Work  Statement  (PWS) 

In  the  actual  work  statement,  the  acquisition  team  will  elaborate  on  the  contents  of  the  PRS  and 
describe  the  requirement  in  such  a  way  that  offerors  will  be  able  to  understand  fully  from  their 
point  of  view,  what  will  be  necessary  to  accomplish  the  requirement.  Issuing  a  draft  PRS  is  always 
a  good  way  of  obtaining  industry  feedback  needed  to  achieve  the  best-quality  work  statement. 
Expect  the  PWS  to  evolve  as  a  result  of  this  feedback.  It  is  also  important  to  allow  adequate  time 
for  meaningful  exchanges  with  industry.  (See  Appendix  H.) 

Manpower  Requirements  and  Labor  Category  Descriptions 

As  reiterated  throughout  this  guidebook,  the  key  to  performance-based  acquisition  is  describ¬ 
ing  requirements  in  terms  of  measurable  outcomes  and  not  in  terms  of  how  to  accomplish  the 
requirement.  This  applies  equally  to  labor  category  descriptions. 

Previously,  manpower  requirements  were  commonly  prescribed  in  terms  of  “required  number 
of  bodies”  or  by  using  other  qualifiers  such  as  college  degrees  or  specific  years  of  experience. 
Prescribing  manpower  requirements  limits  the  ability  of  offerors  to  propose  their  best  solu¬ 
tions,  and  it  could  preclude  the  use  of  contractors’  qualified  personnel,  who  may  be  well  suited 
for  performing  the  requirement  but  may  lack,  for  example,  a  college  degree  or  the  exact  years 
of  specified  experience. 

Instead,  the  requirement  should  be  described  in  a  way  that  allows  offerors  to  meet  the  require¬ 
ment  by  applying  alternative  sets  of  resources.  Offerors  can  then  propose  their  best  solutions 
for  manpower  requirements,  in  accordance  with  the  described  requirement.  Once  the  offeror 
submits  its  proposal,  the  acquisition  team  will  evaluate  the  offeror’s  proposal,  including  man¬ 
power  solutions,  for  best  value. 

Since  performance-based  acquisition  methodologies  are  results-oriented,  agencies  should  not 
focus  on  contractor-proposed  labor  mixes  after  contract  award  as  long  as  the  desired  outcome 
is  achieved  in  accordance  with  the  stated  performance  standards  and  any  other  requirements  in 
the  contract. 

Historical  and  Projected  Workload  Data 

Consider  including  historical  and  projected  workload  data  and  any  surge  requirements  in  the 
PWS  as  applicable.  (See  Appendix  E  for  an  example.)  This  type  of  information  allows  prospec¬ 
tive  contractors  to  predict  manpower  and  supply  needs  more  accurately  as  they  relate  to  the 
specific  requirement  and,  thus,  to  develop  more  realistic  proposals.  While  historical  data  are 
often  useful,  it  is  important  to  remember  that  they  merely  describe  past  experience  and  may  not 
necessarily  be  indicative  of  the  future. 

Workload  data  are  often  available  from  existing  management  information  systems,  databases, 
and  records.  If  workload  data  are  not  available,  consider  consulting  with  other  agencies  to 
obtain  information  on  similar  requirements.  Some  agencies  incorporate  a  requirement  to 
maintain  accurate  workload  data,  which  can  be  useful  for  future  contract  work  estimates,  in 
PWSs. 
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Performance  Work  Statement  Review  Considerations 

•  Will  offerors  be  able  to  prepare  a  sound  technical  proposal?  Are  specific  outcomes  clearly 
stated  so  that  the  offeror  will  know  exactly  what  to  do  and  when  it  is  required?  Are  tasks 
realistic  and  performable? 

•  Will  offerors  be  able  to  prepare  a  sound  cost  proposal?  Is  the  PWS  sufficiently  detailed  to 
enable  both  the  government  and  the  offeror  to  estimate  labor  and  other  costs  and  to  identify 
other  resources  required  for  accomplishing  each  task  element? 

•  Are  standards  clearly  identified  in  such  a  way  that  all  parties  can  adequately  measure  perfor¬ 
mance?  Is  the  PWS  too  restrictive? 

•  Are  proper  quantities  and  delivery  dates  indicated  for  each  deliverable?  Are  schedules  and 
frequencies  of  performance  clearly  defined? 

•  When  it  becomes  necessary  to  reference  other  documents,  are  they  properly  described  and 
cited? 

•  Have  the  appropriate  government  and  industry  standards  been  researched  and  referenced  in 
the  PWS? 

•  Have  any  data  requirements  been  specified  separately  in  a  data  requirements  section?  Have 
extraneous  data  requirements  been  eliminated? 
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INCENTIVES  AND  REMEDIES 


Introduction 

Incentives  are  not  unique  to  performance-based  contracting.  Contracts,  by  their  very  nature, 
motivate  successful  performance  —  contractors  that  fail  to  perform  satisfactorily  don’t  get 
paid.  Increasingly,  contracts  are  incorporating  specified  incentives  designed  to  encourage 
superior  performance.  Beyond  that,  the  government  collects,  maintains,  and  uses  information 
on  past  performance.  An  exceptional  track  record  gives  a  contractor  a  competitive  edge  in 
future  source  selections  and,  thus,  a  stronger  assurance  of  future  work.  Conversely,  negative 
incentives  are  generated  when  certain  contract  clauses  exist,  such  as  liquidated  damages  —  if 
the  contractor  causes  harm  or  damage  to  the  government  as  a  result  of  failure  to  perform,  the 
contractor  must  compensate  the  government  in  accordance  with  the  contract  clause.  The 
overall  point  is  that  incentives  are  an  essential  element  of  PBS  A  (or  any  contract),  and  several 
useful  methodologies  are  available  for  motivating  high-quality  performance.  This  section 
discusses  the  use  of  these  incentives  and  remedies. 

Types  of  Incentives 

Incentives  can  be  monetary,  nonmonetary,  positive,  or  negative.  They  can  be  based  on  cost,  on 
schedule,  or  on  quality  of  performance.  Regardless  of  the  final  composition  and  structure  of  the 
incentives,  the  goal  is  to  encourage  and  motivate  the  best-quality  performance. 

Cost-based  Incentives  —  Performance  incentives  are  designed  to  relate  profit  or  fee  to  results 
achieved  by  the  contractor  in  relation  to  identified  cost-based  targets.  Typical  measures  for  services, 
such  as  maintenance  of  equipment,  are  Mean  Time  Between  Failures  (MTBF),  Mean  Time  To 
Repair  (MTTR),  or  system  availability  rates  (in-commission  rates).  Regardless  of  the  measure, 
performance  incentives  must  be  quantified  and  within  a  reasonable  range  (high-target-low). 

Award-fee  Contract  Arrangements  —  Using  evaluation  factors  established  in  an  award-fee  plan, 
award-fee  contracts  are  a  tool  for  subjectively  assessing  contractor  performance  for  a  given  evaluation 
period.  They  allow  contractors  to  earn  a  portion  (if  not  all)  of  an  award-fee  pool,  established  at  the 
beginning  of  the  evaluation  period.  The  agency  unilaterally  determines  the  amount  of  the  earned  fee. 
In  the  context  of  PBS  A,  the  award-fee  evaluation  is  based  on  a  subjective  assessment  of  how  well  the 
contractor  meets  or  exceeds  the  applicable  performance  standards. 

Award-term  Contract  Arrangements — Award-term  arrangements  are  relatively  new.  They  are 
very  similar  to  award-fee  contracts;  however,  instead  of  money  as  compensation  for  quality  perfor¬ 
mance,  the  contractor  is  awarded  additional  periods  of  performance.  If  performance  is  habitually 
below  standard,  the  period  of  performance  can  be  shortened.  Award-term  arrangements  are  most 
suitable  when  the  establishment  of  a  long-term  relationship  is  valuable,  both  to  the  government  and 
to  the  potential  contractor.  They  differ  from  options  because  award  terms  are  based  on  a  formal 
evaluation  process  and  do  not  entail  the  regulatory  procedures  associated  with  priced  options.  (See 
Appendix  I  for  more  information.) 
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Schedule  Incentives:  Schedule  incentives  focus  on  getting  a  contractor  to  exceed  delivery  expecta¬ 
tions.  They  can  be  defined  by  using  calendar  days  or  months,  attaining  or  exceeding  milestones,  or 
meeting  rapid-response  or  urgent  requirements. 

Past  Performance:  Past  performance  information  can  affect  decisions  to  exercise  options  or  to 
make  future  contract  awards.  Thus,  past  performance  assessments  are  a  quick  way  for  motivating 
improved  performance  or  to  reinforce  exceptional  performance.  Keep  in  mind  that  the  integrity  of  a 
past  performance  evaluation  is  essential. 

Considerations  When  Contemplating  Incentives 

•  Will  enhanced  performance  provide  additional  value  to  the  mission? 

•  Which  areas  of  the  requirement  would  benefit  most  from  enhanced  performance?  Which  areas 
do  not  need  added  incentives? 

•  How  much  is  the  agency  willing  to  pay  to  achieve  a  level  of  performance  beyond  the  perfor¬ 
mance  standard?  Is  there  a  potential  for  using  cost  sharing? 

•  Do  contractors  within  a  particular  industry  prefer  additional  performance  periods  (award 
terms)  in  lieu  of  monetary  incentives  (award  fees)? 

•  Is  the  incentive  affordable?  Will  it  affect  timelines  or  schedules  in  a  positive  way?  Adversely? 

Tips: 

•  Make  sure  incentives  are  realistic  and  attainable  —  in  other  words,  understand  that  a  contrac¬ 
tor  will  not  spend  a  dime  to  earn  a  nickel.  To  achieve  the  desired  outcome,  incentives  should 
be  consistent  with  the  effort  and  the  contract  value.  They  must  also  be  carefully  structured  to 
consider  their  overall  impact  and  to  avoid  any  unintended  consequences  while  providing 
value  for  achieving  the  mission. 

•  Make  sure  that  incentives  are  built  upon  performance  objectives  and  performance  standards, 
and  ensure  that  they  are  measurable  and  attainable.  If  they  do  not  clearly  communicate  the 
agency’s  desires  and  expectations,  they  will  have,  at  best,  only  a  random  chance  of  achieving 
the  desired  outcome.  An  “I’ll  know  it  when  I  see  it”  approach  is  neither  an  incentive  nor  a 
performance  standard. 

Remedies  for  Nonperformance 

Performance-based  contracts  should  specify  procedures  or  remedies  for  reductions  in  price  (or 
fee)  when  services  are  not  performed  or  do  not  meet  contract  requirements.  Additionally,  agen¬ 
cies  must  give  the  contractor  an  opportunity  to  correct  nonconforming  services  at  no  increase  in 
contract  price.  While  reductions  in  price  may  be  appropriate  for  a  particular  circumstance,  it  may 
be  more  feasible  to  require  the  contractor  to  re-perform  the  service  at  no  additional  cost.  Accep¬ 
tance  procedures  should  provide  the  appropriate  terms  to  address  less-than-satisfactory  perfor¬ 
mance.  In  cases  where  commercial  item  acquisition  procedures  are  used,  agencies  should  rely  on 
a  contractor’s  existing  quality  assurance  systems  as  a  substitute  for  acceptance  procedures.  The 
bottom  line  is  that  agencies  should  not  pay  for  services  that  do  not  conform,  do  not  meet  perfor¬ 
mance  standards,  or  have  not  been  properly  rendered. 
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CONTRACTOR  PERFORMANCE  MANAGEMENT 


Introduction 

Traditionally,  when  discussing  performance-based  contracting  methods,  the  term  “quality  assur¬ 
ance”  has  been  used  to  refer  to  the  functions  performed  by  the  government  to  determine  whether  a 
contractor  has  fulfilled  the  contract  obligations  pertaining  to  quality  and  quantity.  The  term  “quality 
assurance,”  however,  does  not  accurately  capture  the  true  essence  of  performance-based  service 
acquisition,  since  agencies  do  not  “assure  quality” — they  assess  contractor  performance.  Thus, 
performance  assessment  is  not  surveillance.  In  fact,  in  a  performance-based  environment,  it  is  the 
contractor  that  is  contractually  responsible  for  quality  assurance;  and  the  contractor  is  further 
motivated  through  various  kinds  of  incentives,  such  as  award-fee  and  past  performance  assess¬ 
ments.  Agencies  are,  however,  still  responsible  for  ensuring  that  they  get  what  they  are  paying  for 
by  performing  periodic  performance  evaluations  using  appropriate  assessment  methods.  Hence- 
forth,  for  accuracy,  the  term  “performance  assessment”  will  be  used  in  place  of  “quality  assurance” 
unless  otherwise  noted. 

Performance  Assessment  Plan 

A  performance  assessment  plan  describes  how  government  personnel  will  evaluate  and  assess 
contractor  performance.  It  is  intended  to  be  a  “living”  document  that  should  be  revised  or  modified 
as  circumstances  warrant.  It  is  based  on  the  premise  that  the  contractor,  not  the  government,  is 
responsible  for  managing  and  ensuring  that  quality  controls  meet  the  terms  of  the  contract.  If  the 
performance  assessment  plan  is  not  incorporated  into  the  contract,  it  should  nevertheless  be  fur¬ 
nished  to  the  contractor. 

Quality  Control  Plan 

A  quality  control  plan  is  a  plan  developed  by  the  contractor  for  internal  use  to  ensure  that  high- 
quality  service  is  performed  and  delivered.  Often  the  quality  control  plan  is  part  of  the  contractor  s 
original  proposal;  and,  in  many  cases,  it  is  incorporated  into  the  resultant  contract. 


Assessment  Methods 

Several  methods  can  be  used  to  evaluate  a  contractor’s  performance.  Below  are  some  examples  of 
commonly  used  assessment  methods: 

Random  Sampling  —  Random  sampling  is  a  statistically  based  method  that  assumes  receipt  of 
acceptable  performance  if  a  given  percentage  or  number  of  scheduled  assessments  are  found  to  be 
acceptable.  The  results  of  these  assessments  help  determine  the  government’s  next  course  of  action 
vis-a-vis  the  contractor,  if  necessary,  and  whether  adjustments  in  this  method  of  assessment  are 
necessary.  If  performance  is  considered  marginal  or  unsatisfactory,  the  evaluators  document  their 
finding  and  begin  corrective  action.  If  performance  is  satisfactory  or  exceptional,  they  should 
consider  adjusting  the  sample  size  or  sampling  frequency.  Random  sampling  is  the  most  appropri¬ 
ate  method  for  frequently  recurring  tasks;  it  is  most  effective  when  the  number  of  instances  is  very 
large  and  when  a  statistically  valid  sample  can  be  obtained. 
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Periodic  Sampling  —  Periodic  sampling  is  similar  to  random  sampling,  but  it  is  planned  at 
specific  intervals  or  dates.  It  may  be  appropriate  for  tasks  that  occur  infrequently.  Selecting  this 
tool  to  determine  a  contractor’s  compliance  with  contract  requirements  can  be  quite  effective, 
and  it  allows  for  assessing  confidence  in  the  contractor  without  consuming  a  significant  amount 
of  time. 

Trend  Analysis  —  Trend  analysis  should  be  used  regularly  and  continually  to  assess  the 
contractor’s  ongoing  performance.  It  is  a  good  idea  to  build  a  database  from  data  gathered 
through  performance  assessments.  Additionally,  contractor-managed  metrics  may  provide  any 
added  information  needed  for  the  analysis.  This  database  should  be  created  and  maintained  by 
government  personnel. 

Customer  Feedback  —  Customer  feedback  is  firsthand  information  from  the  actual  users  of  the 
service.  It  should  be  used  to  supplement  other  forms  of  evaluation  and  assessment,  and  it  is 
especially  useful  for  areas  that  do  not  lend  themselves  to  the  typical  forms  of  assessment.  How¬ 
ever,  customer  feedback  information  should  be  used  prudently.  Sometimes  customer  feedback  is 
complaint-oriented  and  subjective  in  nature,  and  it  may  not  always  relate  to  actual  requirements 
of  the  contract.  Such  information  requires  thorough  validation. 

Third-party  Audits  —  The  term  “third-party  audits”  refers  to  contractor  evaluation  by  a  third- 
party  organization  that  is  independent  of  the  government  and  the  contractor.  All  documentation 
supplied  to,  and  produced  by,  the  third  party  should  be  made  available  to  both  the  government 
and  the  contractor. 

Performance- Assessment  Plan  Development 

Performance-assessment  plans  should  be  developed  in  conjunction  with  the  preparation  of  the  perfor¬ 
mance  work  statement.  For  every  performance  objective  listed  in  the  Performance  Requirements 
Analysis,  determine  one  or  more  methods  of  performance  assessment.  Also,  make  sure  that  the 
methods  allow  for  adequate  assessment  of  the  performance  standard  itself —  in  other  words,  deter¬ 
mine  if  random  sampling  will  allow  you  to  adequately  measure  performance  in  relation  to  the  stated 
performance  standard. 

The  performance  assessment  plan  should  outline  the  acceptance  process  and  should  state  how 
acceptance  of  services  will  occur,  i.e.,  DD-250,  etc.  In  addition,  it  should  describe  how  perfor¬ 
mance  information  is  to  be  captured  and  documented  so  it  can  serve  as  past  performance  informa¬ 
tion  later. 

Effective  use  of  the  performance  assessment  plan,  in  conjunction  with  the  contractor’s  quality 
control  plan,  will  allow  the  government  to  evaluate  the  contractor’s  success  in  meeting  the  specified 
contract  requirements.  Those  assessment  methods  identified  in  the  performance  assessment  plan, 
together  with  the  contractor’s  quality  control  plan,  will  also  help  in  evaluating  the  contractor’s 
success  in  delivering  the  level  of  performance  agreed  to  in  the  contract. 
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Some  Considerations  for  Determining  the  Appropriate  Assessment  Method 

•  What  is  the  most  effective  way  to  assess  the  contractor’s  performance  outcomes  in  relation  to 
the  associated  performance  standards? 

•  How  critical  is  this  particular  task  to  the  requirement  and  to  the  overall  mission?  Is  perfor¬ 
mance  assessment  critical  to  a  particular  task,  and  is  it  is  worth  the  government’s  time  and 
effort? 

•  How  long  should  the  assessment  period  be?  How  is  this  linked  to  the  criticality  of  the  task? 
How  frequently  should  performance  assessment  take  place? 

•  Are  assessors  (quality  assurance  evaluators)  available?  Are  there  enough  evaluators  to  carry 
out  the  degree  of  evaluation  contemplated? 

•  Do  the  proposed  evaluation  methods  represent  a  common  commercial  practice  for  the  particular 
service  area? 

•  Is  re-performance  practical  or  reasonable? 

Suggested  Performance  Assessment  Plan  Outline 

•  Purpose 

•  Roles  and  responsibilities 

•  Procedures 

•  Methods  of  assessment 

•  Successful  performance  and  remedies 

•  Certification  of  services 

•  Sample  of  contract  discrepancy  report 

•  Customer  complaint  procedures  and  training  instructions 

•  Acronyms  and  other  abbreviations 

Tips: 

•  Employ  a  variety  of  techniques.  Degrees  of  performance  assessment  should  be  based  on  the 
criticality  of  the  service  or  task  and,  also,  on  the  resources  available  to  accomplish  the  assess¬ 
ment. 

•  Recognize  that  the  methods  and  degrees  of  performance  assessment  may  change  over  time  in 
proportion  to  the  evaluator’s  level  of  confidence  (high  or  low)  in  the  contractor’s  performance. 

•  Degrees  of  performance  assessment  are  typically  based  upon  difficulty  or  criticality  of  a 
service  —  the  greater  the  difficulty  or  criticality,  the  more  performance  assessment  may 
initially  be  necessary. 
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SOURCE  SELECTION  CONSIDERATIONS 


Introduction 

PBSA  source  selection  procedures  do  not  necessarily  differ  from  source  selection  procedures  in 
general  or  have  special  considerations.  However,  there  are  some  key  areas  worthy  of  brief  review. 

The  key  to  successful  use  of  any  factor  in  the  source  selection  process  is  the  establishment  of  a  clear 
relationship  between  the  Performance  Work  Statement  (PWS),  Section  L  of  the  solicitation  (Instruc¬ 
tions,  Conditions,  and  Notices  to  Offerors  or  Respondents),  and  Section  M  of  the  solicitation  (Evalua¬ 
tion  Factors  for  Award).  The  factors  that  are  chosen  for  evaluation  should  tie  in  with  the  work  re¬ 
quirements. 

Best  Value 

A  source  selection  based  on  best  value  is  an  excellent  strategy  to  follow  when  using  performance- 
based  contracting  methods.  One  of  the  goals  of  PBSA  is  to  achieve  the  highest  degree  of  quality 
and  efficiency  at  a  reasonable  price.  While  competition  is  critical  to  attaining  these  goals,  the  best- 
value  offeror  may  not  be  the  lowest  price  offeror.  In  such  instances,  best-value  source  selections 
allow  for  trade-offs  in  evaluation  factors  that  consider  award  to  other  than  the  lowest-priced  offeror. 

One  of  the  main  challenges  in  determining  best  value  is  assessing  performance  risk.  This  is  chal¬ 
lenging  because  the  offerors  may  propose  different  approaches  that  can  be  difficult  to  compare,  i.e., 
an  “apples  to  oranges”  comparison.  While  Section  M  of  a  solicitation  provides  the  basis  for  evalua¬ 
tion,  there  is  no  precise  science  when  assessing  dissimilar  approaches  toward  fulfilling  a  perfor¬ 
mance-based  service  requirement.  If  no  expertise  is  available,  consider  enlisting  the  aid  of  consult¬ 
ants,  if  possible. 

Instructions  to  Offerors 

Section  L  of  the  solicitation  provides  information  and  guidance  to  help  offerors  prepare  proposals  in 
response  to  the  solicitation.  As  previously  stated,  the  PWS,  Section  L,  and  Section  M  all  tie  together. 
The  PWS  describes  the  requirement.  For  evaluation  purposes.  Section  L  requests  information  relating 
to  how  the  offeror  will  execute  that  requirement.  For  source  selection  purposes.  Section  M  describes 
how  the  proposal  will  be  evaluated.  To  simply  illustrate  the  relationships  among  the  three  areas,  the 
following  example  describes  one  piece  of  a  requirement: 


Peiformance  Work 
Statement 

Section  L 

Section  M 

Provide  taxi  service 
so  that  pick  up  time 
is  within  5  minutes  of 
of  request  time,  95% 
of  the  time. 

The  offeror  shall 
describe  how  taxi 
service  will  be 
provided  in  accord¬ 
ance  with  the  stated 
requirement. 

The  agency  will  evaluate  the  offeror’s 
approach  for  taxi  service.  The  offer  will  be 
evaluated  for  best  value,  in  terms  of  technical 
merit  and  cost,  with  additional  consideration 
for  the  offeror’s  relevant  past  performance 
(track  record). 
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Evaluation  Factors 

Evaluation  factors  used  for  assessing  offerors’  proposals  should  be  crafted  to  permit  the  selection  of 
the  offeror  that  will  most  likely  provide  the  best  value.  To  help  ensure  that  selection  decisions  are 
based  on  significant  determinants,  evaluation  factors  should  be  kept  to  a  minimum.  Each  factor 
should  receive  the  appropriate  weighting  based  on  its  relative  importance.  Evaluation  factors  may 
include  areas  such  as  management  approach,  relevant  experience,  past  performance,  and  price. 


Past  Performance  Information 

Past  performance  information  should  be  an  important  element  of  every  evaluation  and  contract 
award.  The  use  of  past  performance  as  an  evaluation  factor  in  the  contract  award  process  enables 
agencies  to  predict  the  quality  of  future  work  and  the  likelihood  that  the  work  will  be  satisfactory.  It 
also  gives  contractors  a  powerful  incentive  to  strive  for  excellence.  Performance  factors  should  be 
tailored  to  the  key  performance  requirement.  For  example,  if  one  of  the  performance  standards  for 
a  call-center  requirement  is  that  the  contractor  must  respond  within  two  minutes  when  answering 
specific  questions,  the  performance  evaluation  can  objectively  address  how  well  the  contractor  met 
this  standard  in  performing  past  contracts. 

Consider  using  past  performance  information  from  a  wide  variety  of  sources,  both  inside  and 
outside  DoD.  The  DoD  Guide  to  Collection  and  Use  of  Past  Performance  Information  (PPI)  is  a 
great  source;  and  it  will  help  you  understand  the  importance  of  PPI  in  awarding  and  administering 
government  contracts.  It  is  also  a  practical  reference  tool  regarding  DoD  past  performance  policy. 
The  guide  is  designed  to  articulate  the  key  techniques  and  practices  for  collecting  and  using  perfor¬ 
mance  information.  For  further  details  on  this  subject,  enter  http://www.acQ.osd.mi1/ar/#ppiguide 
on  the  Internet. 
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CONTRACT  ADMINISTRATION  AND  OTHER  CONSIDERATIONS 


Introduction 

Contract  administration  embraces  all  those  after-award  activities  performed  by  government  officials  to 
ensure  the  performance  and  delivery  of  requirements  within  the  terms  of  the  contract.  It  encompasses 
all  activities  involving  the  government  and  the  contractor,  from  contract  award  through  performance 
completion  and  contract  closeout.  Contract  administration  constitutes  the  management  of  the  contract 
from  both  a  contractual  and  technical  standpoint  to  assure  that  the  contractor  delivers  in  accordance 
with  the  contract’s  terms.  Therefore,  it  is  incumbent  upon  the  PBSAteam  to  understand  some  of  the 
common  activities  within  contract  administration  and  their  role  in  this  process. 

The  specific  nature  and  extent  of  contract  administration  varies  from  contract  to  contract.  It  can  range 
from  the  minimum  acceptance  of  a  delivery  and  payment  for  delivery  to  extensive  involvement  by 
program,  audit,  and  procurement  officials  throughout  the  contract  term.  Factors  influencing  the  degree  of 
contract  administration  include  the  nature  and  complexity  of  the  service  and  the  type  of  contract. 

Good  contract  administration  also  assures  that  the  end  users  are  satisfied  with  the  product  or  service 
being  obtained  under  the  contract.  One  way  of  verifying  customer  satisfaction  is  to  obtain  input 
directly  from  the  customers  through  the  use  of  customer  satisfaction  surveys.  These  surveys  help  to 
improve  contractor  performance  because  the  feedback  can  be  used  to  notify  the  contractor  when 
specified  aspects  of  the  contract  are  not  being  met.  Customer  satisfaction  surveys  also  help  to 
improve  communications  between  the  procurement,  program,  and  the  contractor’s  personnel. 

Postaward  Orientation 

The  purpose  of  a  postaward  orientation  is  to  ensure  that  the  contractor  and  the  government  com¬ 
pletely  understand  their  respective  roles  in  the  contract  arrangement  and  their  relationship  after 
award  and  before  contract  performance  begins.  While  the  decision  to  conduct  a  postaward  confer¬ 
ence  is  at  the  discretion  of  the  contracting  officer,  postaward  orientations  are  highly  recommended 
to  encourage  a  strong  business  relationship  at  the  onset  of  the  contract. 

A  postaward  orientation  allows  all  interested  parties  to  discuss  the  contract  and  the  elements  of  the 
requirement.  This  type  of  discussion  helps  the  contractor  and  the  government  to  achieve  a  clear  and 
mutual  understanding  of  contract  requirements,  terms,  and  conditions  and  to  identify  and  resolve  any 
potential  or  current  problems.  However,  the  contractor  should  already  have  a  strong  working  knowl¬ 
edge  of  the  requirement.  All  issues  discussed  during  the  postaward  conference  should  be  docu¬ 
mented. 

Documenting  Contractor  Performance  Assessments 

Each  performance  assessment  activity  should  be  documented  as  it  is  conducted.  This  documenta¬ 
tion  constitutes  an  official  record  and  may  be  considered  past  performance  information.  The  people 
assessing  performance  should  use  a  checklist  to  record  their  observations  of  the  contractor’s  perfor¬ 
mance.  ALL  performance  should  be  documented,  whether  it  is  acceptable  or  unacceptable  in 
accordance  with  the  performance  assessment  plan. 
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APPENDIX  A  -  TREE  DIAGRAM 


Critical  Elements  of  Maid  Service 
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APPENDIX  B  -  PERFORMANCE  REQUIREMENTS  SUMMARY 
MATRIX 


Performance  Requirements  Summary  Matrix 


Performance 

Performance 

Acceptable 
Quality  Level 

Monitoring 

Objective 

Standard 

(AOL) 

Method 

Incentive 

APPENDIX  C  -  SAMPLE  PERFORMANCE  REQUIREMENTS 


Providing  Access  to  a  Service 


Performance 

Objective 

Performance  Standard 
(andAQL) 

Method  of  Perfomance 

Maintain  customer 
access  to  automated 
information  during 
established  hours. 

Services  must  not  be  closed 
to  public  access  more  than 

X  minutes  during  the  month 
(day,  hour). 

•  Random  inspection  (site  visits, 
telephone  calls). 

•  Random  automated  telephone 
systems  reports. 

•  Review  contractor  reports. 

Courtesy  of  Jefferson  Solutions 


Maintaining  an  Information  Database 


il  Performance  , , 

^  ^  Oiuecti0^?|||'i|i^ 

. :■  . ' _ . L:1 

Maintain  an  elec¬ 
tronic  database. 

The  inquiry  response  database 
may  not  contain  more  than 
of  incorrect,  inaccessible,  or 
inappropriate  lines  of  information. 

Review  random  portions  of 
database  for  accuracy, 
appropriateness,  and  accessibility 
of  information. 

Courtesy  of  Jefferson  Solutions 


Reporting  to  the  Government 


Performance 

Objective 

Performance  Standard 
.■'(mdAQL):  ;  t 

•  Method  of  Performance 
'  Assessment 

Provide  timely 
notification  on  items 
requiring  govern¬ 
ment  action. 

No  more  than  x  (or  \%)  of  the 
reports  to  appropriate  govern¬ 
ment  contact  may  be  later  than 
the  specified  time  period,  AND/ 
OR  no  more  than  x  (or  x%)  of 
required  situations  may  go 
unreported. 

Review  operational  logs, 
databases,  or  metrics. 

Deliver  required 
reports. 

No  more  than  x  (or  x%)  of  the 
reports  to  appropriate  govern¬ 
ment  contact  may  be  later  than  the 
specified  time  period. 

Review  reports  and  logs. 

Gather  required 
information  from 
callers. 

Report  everv  Cmonth, 

quarter)  on  the  statistical  or  other 
information  that  has  been 
gathered.  At  least  x%  of  the 
information  gathered  must  be 
relevant  and  accurate. 

•  Review  records  and  reports. 

•  Make  test  calls. 

•  Randomly  verify  process  on 
site. 

Courtesy  of  Jefferson  Solutions 
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Responding  to  Inquiries 


Performance 

Objective 

Provide  accurate 
and  current  re¬ 
sponses  tailored  to 
the  individual 
needs  of  the  caller 
and  to  agency 
requirements. 

Respond  to  all 
incoming  telephone 
inquiries  during  the 
operating  hours 
within  standard  call 
load. 


Respond  to  surges 
of  telephone 
inquiries  (calls  that 
exceed  the  standard 

call  range  per _ 

(day,  month,  etc.). 


Response  to 
inquiries  must  be 
delivered  in  a 
timely  manner. 


Provide  courteous 
service. 


PerforinanC^^iS^^ 

(andAQL) 

Provide  at  least  \%  acceptable 
responses  during  the  month. 
OR 

Receive  no  more  than  x  valid 
complaints  about  service 
during  the  month. 


Respond  to  at  least  x%  of 
incoming  telephone  calls. 
OR 

Respond  to  at  least  2C%  of 
incoming  telephone  calls 
within  X  seconds. 


Respond  to  at  least  2t%  (less 
than  the  percent  in  the  stan¬ 
dard  above)  of  incoming 
telephone  calls  in  a  surge.  OR 
Within  X  minutes  (  or  hours) 
of  the  beginning  of  a  surge 
respond  to  at  least  \%  (the 
same  percent  as  in  the  stan¬ 
dard  above)  of  incoming 
telephone  calls. 

All  employees  must  be  able  to 
respond  to  any  inquiry  within 
X  minutes.  OR 
At  least  2^  of  callers  must 
receive  a  final  response  from 
the  first  contact. 


Receive  no  more  than  x  valid 
complaints  during  the  month. 


Method  of  Performance 
Assessment 


Make  sample  or  test  calls. 
Review  call  logs. 

Review  standard  scripts. 

Review  complaint  logs. 

Review  quality  control  activities 


Review  of  automated  telephone 
system  data. 

Review  reports. 


Review  of  automated  telephone 
system  data. 

Review  of  reports. 


Make  sample  or  test  calls. 
Review  complaint  logs. 

Review  quality  control  activities. 


Courtesy  of  Jefferson  Solutions 


Supporting  a  Call  Center  Operations 


Performance 

Objective 

Performance  Standard 
(and  AQL) 

Method  of  Performance 
Assessment 

Maintain  all 
equipment  and 
materials. 

Equipment  failures,  nonavail¬ 
ability,  or  maintenance  shall  not 
interfere  with  operations  for 
more  than  x  minutes  during  a 
month  (day,  etc.). 

•  Random  inspection;  audit  or 
review  by  third  party. 

Develop  and  con¬ 
duct  a  liaison 
program. 

Contact  (phone,  visit)  at  least 
x%  of  the  required  offices  each 
month,  with  at  least  x%  of  the 
offices  having  been  contacted 
at  the  end  of  each  year. 

Perform  random  verification  of  list 
of  contacts. 

Develop  and  con¬ 
duct  a  public  out¬ 
reach  program. 

Perform  at  least  of  the 

required  program  each  month, 
with  at  least  x%  of  the  program 
having  been  completed  at  the 
end  of  each  year. 

•  Review  contractor  records  and 
sample  products. 

•  Review  the  effect  on  call  volume 
in  call  records. 

Assure  continuous 
quality  improvement 
in  service  and 
technology. 

Report  every  month  (quarter, 
etc.)  on  improvements  in 
service  and  technology  that 
could  be  implemented. 

Review  recommendations. 

Assure  that 
customers  are 
satisfied  with  quality 
of  service. 

At  least  x%  of  customers 
contacted  (or  potential  custom¬ 
ers  contacted)  must  be  satisfied 
with  service. 

•  Review  and  validate  customer 
surveys. 

•  Conduct  independent  surveys. 

Courtesy  of  Jefferson  Solutions 
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Examples  of  Performance  Requirements  Summary 


Requirement 

(Outcome) 

Performance 

Objective 

Performance  Standard 
and  AQL 

Safety 

program. 

Establish,  implement, 
and  maintain  a  compre¬ 
hensive  safety  program. 

Program  meets  current  requirements  of  federal  law. 

1)  No  OSHA-reportable  violations  resulting  from 
contractor  action  or  inaction. 

2)  Mishap  frequency  and  severity  rate  shall  not 
exceed  the  base  three-year  average. 

Network 
help  desk. 

Provide  timely  and 
efficient  service. 

75%  of  technical  support  questions  resolved  within 
eight  working  hours;  remaining  25%  of  technical 
support  calls  resolved  within  24  working  hours. 

Family 

housing 

maintenance. 

Provi(3e  maintenance  and 
repair  services  to  family 
housing  at  XYZ  location. 

Valid  customer  complaints  concerning  response 
and  execution  of  all  work  orders  shall  not  exceed 

X  per  month. 

Mess  Attendant  Services 


Standard 

AQL 

Prepare  food  listed  on  menu  according  to  commercially 
acceptable  standards  for  the  particular  menu  item. 

95%  of  menu  items  per  meal  period 
meet  the  standard. 

Comply  with  sanitation  requirements  of  the  food 
code  and  state  and  local  laws/regulations,  resulting 
in  a  satisfactory  or  better  rating  in  health  inspections. 

100%  of  the  time  (no  deviation). 

Deliver  timely  service  and  courteous  employees. 

95%  of  monthly  meal  periods  meet  the 
standard. 

Provide  food  supplies,  i.e.,  utensils,  condiments, 
napkins. 

95%  of  monthly  meal  periods  meet  the 
standard. 

Maintain  the  interior  and  exterior  of  the  dining 
facility  in  a  clean  and  sanitary  condition. 

95%  of  the  days  in  the  month  meet  the 
standard. 

Maintain  food  service  during  contingency 
operations  to  ensure  no  impact  on  the  mission. 

100%  of  the  time  (no  deviation). 
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Elevator  Maintenance  and  Repair 


Performanct!  Objective 

Performance  Standard  and  AQL 

Perform  preventive  maintenance. 

Elevators  are  fully  operational  99%  of  the  time. 

Repair  service  calls. 

Repairs  are  made  in  a  timely  manner;  customers  are 
informed  of  expected  repair  time  within  three  hours 
of  call. 

Emergency  calls. 

Response  and  repair  is  made  within  the  specified 
time;  response:  30  minutes. 

Submit  maintenance  and  repair  reports. 

Accurate  reports  are  delivered  within  two  business 
days  90%  of  the  time. 

Lead-Based  Paint  Abatement 


Performance  Objiectfve  ^ 

Performance  Standard  and  AQL 

Remove  lead-based  paint. 

Paint  is  removed  and  no  additional  lead  is  present;  air, 
soil,  and  surrounding  work  area  free  of  lead;  all 
waste  disposed  of  properly;  100%  of  the  time. 

Operations  and  Maintenance  of  an 
Energy  Management  and  Control  System  (EMCS) 


Performance  Objective 

Performance  Standard  and  AQL  ^  ^ 

Operate  EMCS  equipment. 

Comfort  levels  are  maintained;  energy  goals  are  met; 
metrics  are  maintained  on  system  efficiencies;  all 
systems  are  balanced; 

(INSERT  AQL). 

Preventive  maintenance. 

System  is  fully  operational;  system  defects  are 
identified  for  timely  repair; 

(INSERT  AQL). 
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Satellite  Control  Center  Service 


Performance  Objective 

Performance  Standard  and  AQL 

Conduct  an  effective  position  certification 
program  to  ensure  qualified  personnel  are 
provided  for  orbital  analysis. 

95%  of  personnel  certified  within  x  timelines  per 
year  (offeror-proposed). 

Provide  orbital  analysis  and  related  services 
to  support  mission  requirements. 

Telephonic  support  within  15  minutes.  In-person 
support  (as  requested)  within  90  minutes. 

Provide  orbital  safety  support  for  protection 
of  space  systems  from  damaging  debris. 

No  more  than  one  noted  incident  of  system 
impact  per  month. 

Transportation  and  Delivery  of  Munitions/Maintenance  of  Bomb  Racks 


Performance  Objective  and  Standard 

AQL 

Deliver  Munitions 

Priority  1  on  time 

Priority  2  1  hour 

Priority  3  8  hours 

Accurate  deliveries  and  scheduled  delivery  times  met: 
Priority  1  100% 

Priority  95% 

Priority  3  90% 

Maintain  proper  quantity  and  distance. 

No  safety  violations. 

Munitions  trailer  maintenance. 

98%  of  trailers  serviceable. 

Adjustment  and  inventory  report. 

No  discrepancies  report  by  MASO. 

Bomb  rack  maintenance. 

95%  of  racks  serviceable. 

Report  of  discrepancies. 

No  reports  received. 
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APPENDIX  D  -  INCENTIVES  EXAMPLES 


POSITIVE 


When  performance  exceeds  standard,  pay  x%  of  monthly  payment  into  pool.  At  end  of  y 
months,  pay  contractor  amount  accrued  in  pool. 

When  performance  exceeds  standard,  pay  2t%  of  monthly  payment  into  pool.  When  pool  has 
reached  y  dollars,  pay  contractor  amount  accrued  in  pool. 

When  performance  has  exceeded  the  standard  for  x  consecutive  months,  reduce  government 
oversight  or  contractor  reporting  as  appropriate. 

Document  past-performance  report  card,  paying  particular  attention  to  performance  that  ex¬ 
ceeded  the  standard. 

Courtesy  of  Jefferson  Solutions 


NEGATIVE 


When  performance  is  below  standard  for  a  given  time  period,  of  that  period’s  payment  will 
be  withheld. 


When  performance  is  below  standard  for  a  given  time  period,  require  the  contractor  to  re¬ 
perform  the  service  at  no  additional  cost  to  the  government. 

When  performance  is  below  standard  for  x  consecutive  months,  increase  surveillance  or  con¬ 
tractor  reporting. 

Document  past-performance  report  card,  paying  particular  attention  to  performance  that  failed 
to  meet  the  standard. 

Courtesy  of  Jefferson  Solutions 
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APPENDIX  E  -  WORKLOAD  DATA  EXAMPLE 


Elevator  Maintenance 


IQQI 

■  '  Name,.^v;  :,V 

Quantity 

1 

Inspect  and  test  elevators. 

Ea 

2 

Number  of  (LIST  EACH  TYPE  OF  ELEVATOR  SEPARATELY.) 

— 

Ea 

3 

Number  of  (LIST  EACH  TYPE  OF  ELEVATOR  SEPARATELY.) 

— 

Ea 

B 

Number  of  (LIST  EACH  TYPE  OF  ELEVATOR  SEPARATELY.) 

— 

5 

Estimated  number  of  repair  service  calls  per  year. 

— 

Ea 

6 

Estimated  number  of  emergency  repair  calls  per  year. 

Ea 
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APPENDIX  F  -  PERFORMANCE  ASSESSMENT  METHODS 


Customer  Service  Center 


Performance 

Objective  and  Standard 

Method  of  Perfo^iftahte  ,  ^  j 

Emergency  -  30  min  duty  hrs 

1  hr  non-duty 
completed  (safed)  in  24  hrs 
Urgent  -  completed  in  5  days 
Routine  -  completed  in  30  days 

Emergency  100% 

Urgent  98.5% 

Routine  95  % 

Contractor  metrics.  Periodic 
review  of  records  and  cus¬ 
tomer  feedback. 

Control  backlog  of  work 
requests/work  orders. 

Maximum  10%  of  all 
work. 

Contractor  metrics.  Periodic 
review  of  records. 

Operate,  maintain,  and  repair 

UPS  system. 

Maximum  system  utility 
failure  5.3  minutes 
(99.99%)  annually. 

Contractor  metrics.  Periodic 
review  of  maintenance 
records,  outage  reports. 

Environmental  program:  comply 
with  Federal,  State,  local,  DoD, 

AF,  and  base  regulations, 
statutes,  directives,  policies,  and 
programs. 

Zero  environmental 
enforcement  actions. 

Contractor  metrics.  Quality 
audits  of  contractor  records, 
area,  and  inspection  reports. 

Contractor  quality  program. 

Zero  major  &  >  5  minor 
defects  per  period. 

Semiannual  audit  of  govern¬ 
ment  and  contractor  records. 

Deliver  Munitions 


Performance 
Objective  and  Standard 

AQL 

Method  of  Performance 
Assessment 

Priority  1  on  time 

Priority  2  1  hour 

Priority  3  8  hours 

Accurate  deliveries  and 
scheduled  delivery  times  met: 
Priority  1  100% 

Priority  2  95% 

Priority  3  90% 

Review  delivery  schedules. 

Maintain  proper  quantity 
and  distance. 

No  safety  violations. 

Contact  safety  office  for  viola¬ 
tions. 

Munitions  trailer 
maintenance. 

98%  of  trailers  serviceable. 

Review  contractor-provided 
metric. 

Adjust  and  inventory  report. 

No  discrepancies  report  by 
MASO. 

Contact  MASO  for  discrepan¬ 
cies. 

Bomb  rack  maintenance. 

95%  of  racks  serviceable. 

Review  contractor  provided  metric. 
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APPENDIX  G  -  HELPFUL  MARKET  RESEARCH  WEBSITES 


http://www.imart.org/ 

A  collection  of  search  engines,  directories,  and  databases  to  aid  in  market  research, 
http://www.cadv.  org/ 

Disseminates  information  to  enable  exchanges  of  questions  and  answers  and  to  share  best  practices 
and  lessons  learned. 

http://govcon.com 

http://www.industrylink.com 

Hundreds  of  links  to  companies  grouped  by  technology. 
http://bigbook.com 

Yellow  pages  of  16  million  U.S.  businesses. 

http://switchboard.com 
Business  search  engine. 

http://www.techweb.com 

More  than  100  links  to  industry,  focused  on  electronics. 
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APPENDIX  H  -  PERFORMANCE  WORK  STATEMENT  (PWS) 
WRITING  TIPS 


Sample  PWS  Format 

Support  Services  Contracts.  A  PWS  for  support  services  will  generally  describe  all  the  pertinent 
work  to  be  performed,  along  with  measurements  of  adequate  work  performance,  evaluation  and 
assessment  techniques,  and  applicable  incentives.  Below  are  common  elements  that  are  included  in 
a  PWS: 

1 .  Introduction 

2.  Scope  of  Work 

3.  Requirements/Performance  Standards 

4.  Contract  Deliverables 

5.  Data  Requirements 

6.  Appendices 

Major  Systems  Contracts.  Contracts  for  definition  and  development  of  major  systems  should 
consist  of  short,  outcome-based  PWSs;  however,  they  are  not  necessarily  as  detailed  as  a  support- 
service  PWS.  These  requirements  usually  have  a  specification/contract  deliverable  requirements 
list,  which  may  contain  specific  product  requirements.  The  PWS  should  describe  all  requirements 
necessary  to  complete  each  task  element  and  should  be  comprehensive  enough  to  allow  the  con¬ 
tractor  the  means  of  generating  information  necessary  for  design,  prototype,  test,  and  verification 
phases  of  the  procurement.  A  suggested  outline  follows: 

1.  Introduction 

2.  Scope  of  Work 

3 .  Work  to  be  Performed 

3 . 1  Program  Management 

3.2  Systems  Engineering 

3 . 3  Design  and  Development  of  Primary  Mission  Product  or  Space  Vehicle 

3.4  Other  Work 

3.4.1  Launch  Support 

3.4.2  Performance  Assurance 

3.4.3  Training 

3.4.4  Anomaly  Resolution 

3.5  Performance  Standards 

4.  Contract  Deliverables 

The  PWS  goal  for  major  systems  acquisition  is  to  acquire  the  effort  in  distinct  phases,  with  each 
phase  encompassing  a  concrete  objective.  This  approach  also  helps  safeguard  against  committing 
scarce  resources  to  an  effort  prematurely. 


35 


Study  and  Preliminary  Definition  Contract  For  study  and  preliminary  definition  contracts,  the 
PWS  should  provide  sufficient  latitude  for  creativity,  innovation,  and  research.  They  should  also 
describe  desired  outcomes  in  such  a  way  that  allow  the  most  promising  systems  to  be  studied 
further.  A  suggested  outline  follows: 

1.  Introduction 

2.  Scope  of  Work 

3.  Project  Schedule 

4.  Contract  Tasks 

4.1  Performance  Standards 

5.  Study  Management 

6.  Guidelines 

7.  Data  Requirements  Appendix 

Research  and  Development  (R&D)  Contracts.  R&D  efforts  often  focus  on  abstract  objectives, 
where  outcomes  are  difficult  to  describe  precisely  in  advance.  Therefore,  an  R&D  PWS  can  be 
challenging  to  develop.  Consider  breaking  the  effort  into  “sub-outcomes”  or  phases.  The  PWS 
should  be  flexible  to  allow  offerors  the  opportunity  to  innovate  and  create.  In  basic  research, 
emphasis  will  normally  focus  on  limited  rather  than  ultimate  objectives.  The  proper  procurement 
vehicle  is  usually  a  cooperative  agreement  rather  than  a  contract  in  those  basic  research  programs 
where  a  final  report  is  the  only  deliverable  required,  where  the  results  cannot  be  determined  in 
advance,  and  where  objective  performance  standards  cannot  be  set.  A  sample  outline  follows: 

1 .  Introduction 

2.  Scope  of  Work 

3 .  Description  of  Tasks  to  be  Performed 

3 . 1  Performance  Standards 

4.  Schedule 

5.  Reporting  Requirements 

6.  Attachments,  Appendixes  and  Exhibits 

Typical  Sections  of  the  PWS 

Introduction.  Describes  program  goals,  desired  results  to  be  achieved,  interfaces  that  must  be 
considered,  and  any  previous  problems  that  have  been  encountered,  e.g.,  any  known  phenomena, 
techniques,  methodology,  or  results  of  related  work.  Keep  this  section  succinct  and  to  the  point. 

Scope  of  Work.  This  is  a  summary  section  that  briefly  describes  the  purpose  of  the  current  work 
and  the  desired  outcome.  It  should  also  establish  such  general  requirements  as  the  place  of  perfor¬ 
mance,  normal  work  hours,  applicability  of  the  Service  Contract  Act,  etc. 

Requirements.  This  portion  is  basically  where  the  Performance  Requirement  Summary  (PRS)  matrix  is 
transferred  into  the  PWS — in  other  words,  it  is  a  textual  form  of  the  PRS,  which  contains  greater  detail. 
A  contractor  will  have  a  greater  chance  of  success  with  adequate  information  that  clearly  defines  the 
magnitude,  quality,  and  scope  of  each  outcome.  Specify  standards  to  which  the  requirement  must  be 
completed,  and  include  historical  data  on  previous  contracts  or  work  performed  by  in-house  personnel. 
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Data  Requirements.  This  section  contains  information  on  data  requirements,  such  as  reports  or  any 
item  contained  within  a  Contract  Data  Reports  List  (CDRL).  (Some  agencies,  instead,  list  CDRL 
items  separately  in  Section  J  of  the  contract).  Strive  to  minimize  data  requirements  that  require 
government  approval  and  delivery.  Acquire  only  the  data  that  are  absolutely  necessary.  The  usual 
rule  of  thumb  is  to  limit  data  to  that  which  the  government  needs  to  make  decisions  or  for  high- 
level  requirements  compliance. 

Attachments,  Appendixes,  and  Exhibits,  Through  preliminary  research  and  acquisition  planning,  the 
acquisition  team  should  have  already  screened  potentially  relevant  and  necessary  directives,  e.g., 
directives  of  the  government,  DoD,  and  Federal  agencies.  If  only  a  portion  of  a  directive  is  pertinent, 
do  not  reference  or  include  it  in  its  entirety.  Instead,  excerpt  only  required  parts  of  the  directive  into 
the  PWS.  Only  a  few  directives  should  be  referenced,  and  they  should  be  restricted  to  vital  informa¬ 
tion  sources,  such  as  task  descriptions,  quality  standards,  and  statutory  or  regulatory  limitations. 

Many  undesirable  consequences  can  result  from  excessive  or  inappropriate  application  of  direc¬ 
tives,  such  as  confusion  or  error  due  to  conflicting  guidance  or  unintentional  direction  buried 
within  the  document.  If  the  government  specifies  “how  to  perform,”  even  within  the  context  of 
one  or  more  published  documents,  it  then  assumes  outcome  responsibility. 

Any  essential  document  referenced  in  the  solicitation  should  be  furnished  either  with  the  solicita¬ 
tion  or  made  available  at  a  specified  location  noted  in  the  solicitation.  Remember  to  include  the 
date  or  version  of  each  document. 

Schedules  or  Period  of  Performance.  This  PWS  section  provides  a  realistic  delivery  schedule  for 
contractor  performance  and  completion.  Provide  sufficient  detail  for  the  contractor  to  establish 
specific,  detailed  milestones  against  which  progress  can  be  measured. 

Task  Orders.  Task-order  contracts  also  require  well-written,  precise,  definitive  PWSs  that  include 
performance  standards  and  incentives  as  appropriate.  Ensure  that  all  essential  taskings  are  included 
and  that  those  that  are  unnecessary  or  duplicative  are  deleted.  Task  descriptions  should  clearly 
define  each  deliverable  outcome.  Subtasks  should  be  listed  in  their  appropriate  order  and  should 
conform  to  the  numbering  within  the  basic  PWS  from  which  the  task  order  is  derived. 

Language  Principles  Helpful  in  Writing  the  PWS 

The  PWS  will  be  read  and  interpreted  by  a  variety  of  personnel  from  diverse  disciplines.  The 
words  must  be  understood  not  only  by  the  drafters  but  also  by  the  readers.  Moreover,  offerors 
interested  in  proposing  will  interpret  words  within  the  PWS  to  determine  potential  costs,  anticipate 
profits,  and  their  ability  to  compete  with  other  offerors.  Therefore,  define  and  express  each  require¬ 
ment  in  a  clear,  concise,  correct,  and  complete  manner. 

Style.  Style  is  the  method  used  in  expressing  ideas  in  phrases,  sentences,  and  paragraphs.  Strive  to 
include  all  the  essential  information  in  a  concise,  accurate,  thorough,  and  logical  sequence,  using 
the  clearest  and  simplest  possible  presentation.  Avoid  the  use  of  complex  words  —  the  purpose  of 
writing  is  to  express,  not  impress. 
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Sentences.  Good  writing  of  any  type  depends  on  natural  order.  Eliminate  long,  complicated 
sentences  by  writing  shorter,  simpler  sentences  that  are  limited  to  a  single  thought  or  idea.  Sen¬ 
tences  “spiced”  with  legal  phrases,  technical  jargon,  and  other  elaborate  phrases  are  difficult  to  read 
and  comprehend.  Strive  to  omit  extraneous  words  and  phrases  to  keep  sentences  short. 

Para^ra/i^s.  A  paragraph  is  a  group  of  sentences  (or  sometimes  just  one  sentence)  related  to  a 
single  idea.  State  the  main  idea  in  the  first,  or  topic,  sentence  so  readers  can  grasp  the  meaning 
immediately.  The  topic  sentence  provides  a  base  for  subsequent  sentences  that  develop  and  support 
the  main  idea.  Avoid  long  paragraphs  if  possible;  short  paragraphs  are  usually  less  confusing,  more 
visually  appealing,  and  easier  to  read  and  understand. 

Language  Use.  Use  the  active  voice  rather  than  the  passive  voice,  i.e.,  use  action  verbs  that 
illustrate  the  subject  as  performing  rather  than  receiving  the  action.  The  active  voice  is  clearer 
and  more  direct  than  the  passive  voice.  Fewer  words  improve  clarity  and  focus  the  intent  of 
technical  and  contractual  documents.  Also,  by  using  the  active  voice,  you  make  the  subject,  i.e., 
the  contractor,  responsible  and  accountable  for  the  action  or  performance  required.  The  active 
voice  is  tailor-made  for  the  performance-based  contracting  world.  Examples  of  active  versus 
passive  voice  use  are  shown  below: 

Active:  Clean  up  all  debris  at  the  end  of  each  workday. 

Passive:  The  debris  shall  be  picked  up  at  the  end  of  each  workday. 

Active:  Empty  trash  containers  twice  a  week. 

Passive:  Trash  containers  shall  be  emptied  twice  a  week. 

Active:  Install  new  air  filters  in  accordance  with  manufacturer’s  recommendations. 

Passive:  New  air  filters  are  required  in  accordance  with  the  manufacturer’s  recommendations. 

Ambiguity.  Avoid  ambiguous  words  or  phrases  because  they  are  indistinct  and  can  be  interpreted 
in  two  or  more  ways.  Examples  of  some  ambiguous  phrases  include  “securely  mounted,”  “prop¬ 
erly  assembled,”  and  “carefully  performed.”  These  terms  are  ambiguous  because  they  can’t  be 
quantified,  precisely  measured,  or  defined;  and  their  vagueness  can  lead  to  many  interpretations. 

Punctuation.  Since  your  goal  is  to  write  simple,  short,  concise  sentences,  a  well-written  PWS 
should  have  minimum  punctuation.  When  complicated  punctuation  is  required,  consider  rewriting 
the  sentence.  Review  the  punctuation  marks  to  ensure  that  misplaced  or  eliminated  punctuation 
does  not  alter  the  intended  meaning.  For  maximum  clarity,  follow  the  formal  rules  of  punctuation. 

Abbreviations  and  Acronyms.  Abbreviations  and  acronyms  are  forms  of  shorthand  used  to  make 
complex  terms  short.  However,  many  readers  are  unfamiliar  with  abbreviations  and  acronyms, 
and  some  acronyms  have  multiple  meanings.  For  example,  the  acronym  “CO”  can  mean  Com¬ 
manding  Officer,  Contracting  Officer,  or  Change  Order,  depending  on  usage.  For  these  reasons, 
when  a  reference  first  appears,  use  the  full  phrase  and  follow  it  with  the  abbreviation  or  acronym 
in  parentheses,  e.g..  Commanding  Officer  (CO).  When  there  are  many  abbreviations  and/or 
acronyms,  include  a  glossary. 
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Symbols.  Use  the  full  word  associated  with  the  symbol  unless  the  meaning  is  universally  clear.  For 
example,  it  is  best  to  use  foot  for  inch  for  ”,  pound  for  #,  at  for  @,  and  percent  for  %. 

Numbers.  Spell  out  numbers  under  10,  and  use  numerals  for  figures  10  and  above.  Represent 
dimensions,  degrees  of  temperature,  percentages,  and  dollars/cents  as  numerals,  e.g.,  2  inches  by  4 
inches,  40  degrees  F.,  30  percent,  $6.75.  “One”  or  “zero”  should  always  be  spelled  out  when  used 
alone.  When  two  numbers  are  used  together  to  define  both  size  and  quantity,  use  a  written  word  for 
one  number,  e.g.,  six  55-gallon  metal  drums  or  eight  40-cubic  yard  containers.  You  can  express  the 
same  number  in  both  words  and  numerals,  e.g.,  ten  (10)  calendar  days,  but  this  duplication  is 
usually  considered  superfluous. 

Redundancy  and  Repetition.  Avoid  redundancy  and  unnecessary  repetition.  They  reduce  clarity 
and  increase  the  likelihood  of  ambiguity,  inconsistency,  and  internal  contradiction. 

Misused  Words  and  Phrases.  Avoid  certain  words  and  phrases  when  developing  a  government 
contract.  If  you  use  these  words  improperly,  the  reader  will  not  have  a  clear  understanding  of  the 
government’s  requirements.  Examples  of  these  words  and  phrases  and  information  regarding  how 
they  impact  government  contracts  follow: 

1 .  Use  of  shall  and  will.  “Shall”  is  used  to  specify  that  a  provision  is  binding.  It  ordinarily 
describes  the  work  required  of  the  contractor.  “Will,”  on  the  other  hand,  is  used  simply  to 
express  a  statement  of  acts  and  actions  that  will  occur  in  the  future. 

2.  Use  of  any  and  either.  These  words  imply  a  choice  regarding  what  is  to  be  done  contractu¬ 
ally.  Unless  the  intent  is  to  give  the  contractor  a  choice,  specify  the  true  intent.  For  instance, 
the  word  “any”  means  a  limited  number  selected  at  the  discretion  of  the  reader  (contractor). 
The  statement,  “mow  any  areas  over,”  can  mean  any  of  the  areas  selected  by  the  contractor, 
while  “mow  areas  over”  means  every  area  spelled  out  in  the  requirements.  The  word  “either” 
implies  a  choice  between  two  options.  If  the  intent  is  to  require  the  contractor  to  clean  both 
sides  of  the  glass,  “clean  glass  on  either  side”  is  an  incorrect  statement. 

3.  Use  of  and,  or,  and/or,  and  etc.  Use  “and”  if  both  conditions  are  to  be  included;  use  “or”  if 
only  one  of  the  conditions  is  to  be  included.  Avoid  using  “and/or”  because  this  term  creates 
ambiguity,  i.e.,  both  conditions  can  apply  or  only  one  can  apply  —  the  reader  does  not  know 
which.  Because  “etc.”  means  “others  of  the  same  kind  and  so  forth,”  the  reader  can  easily 
misinterpret  its  meaning. 


39 


APPENDIX  I  -  AWARD  TERMS 


Sample  of  an  Award-Term  Plan 

1.0  Introduction 

This  is  the  basis  for  evaluating  the  contractor’s  performance  and  for  presenting  an  assessment  of 
that  performance  to  the  Term-Determining  Official  (TDO).  The  evaluation  for  the  number  of  term 
points  to  be  awarded  will  begin  at  the  start  of  the  contract. 

Award-term  contracting  is  effective  when  the  following  conditions  exist: 

•  performance  metrics  are  objective, 

•  a  long-term  business  relationship  is  of  value  to  the  government  and  to  the  contractor,  and 

•  the  expected  outcomes  are  known  up-front. 

The  specific  criteria  and  procedures  used  for  assessing  the  contractor’s  performance  and  for  deter¬ 
mining  the  award  term  earned  are  described  herein.  All  TDO  decisions  regarding  the  award-term 
points  are  final  and  not  subject  to  dispute.  Such  TDO  decisions  include,  but  are  not  limited  to,  the 
number  of  points,  if  any;  the  methodology  used  to  calculate  the  points;  the  calculation  of  the  points; 
the  contractor’s  entitlement  to  the  points;  and  the  nature  and  success  of  the  contractor’s  perfor¬ 
mance.  The  award  term  will  be  provided  to  the  supplier  through  unilateral  contract  modifications 
based  upon  points  earned  as  determined  by  the  TDO. 

2.0  Organization 

The  award-term  organization  includes  the  TDO  and  an  Award-Term  Review  Board  (ATRB) 
consisting  of  a  chairperson,  the  contracting  officer,  a  recorder,  other  functional-area  participants, 
advisory  members,  and  the  performance  monitors. 

3.0  Responsibilities 

a.  Term-Determining  Official.  The  TDO  approves  the  award-term  plan  and  any  significant 
changes  to  it.  The  TDO  reviews  the  recommendations  of  the  ATRB,  considers  all  pertinent  data, 
and  determines  the  earned  award-term  points  for  each  evaluation  period.  The  TDO  appoints  the 
ATRB  chairperson. 

b.  Award-Term  Review  Board  Chairperson.  The  ATRB  chairperson  chairs  the  meetings  of 
the  ATRB  and  appoints  the  nonmandatory  members  of  the  board  and  the  performance  monitors. 
The  ATRB  chairperson  briefs  the  TDO  on  recommended  earned  term  amounts  and  the  contractor’s 
overall  performance  and,  also,  recommends  award-term  plan  changes  to  the  TDO. 

c.  Award-Term  Review  Board.  ATRB  members  review  performance  monitors’  evaluation  of 
the  contractor’s  performance,  consider  all  information  from  pertinent  sources,  prepare  interim 
performance  reports,  and  arrive  at  the  earned  award-term  points  recommendation  to  be  presented  to 
the  TDO.  The  ATRB  will  also  recommend  changes  to  this  plan.  An  assessment  of  the  contractor’s 
performance  will  be  performed  on  a  yearly  basis. 
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d.  ATRB  Recorder.  The  ATRB  recorder  is  responsible  for  coordinating  the  administrative 
actions  required  by  the  performance  monitors,  the  ATRB,  and  the  TDO. 

e.  Contracting  Officer  ( CO).  The  CO  is  the  liaison  between  contractor  and  government 
personnel.  Subsequent  to  the  TDO’s  decision,  the  CO  evaluates  the  award-term  points  available 
and  modifies  the  contract  period  of  performance,  if  necessary,  to  reflect  the  decision. 

f.  Performance  Monitors.  Performance  monitors  maintain  written  records  of  the  contractor’s 
performance  in  their  assigned  evaluation  areas  so  a  fair  and  accurate  evaluation  is  obtained.  Moni¬ 
tors  prepare  interim  and  end-of-period  evaluation  reports  as  directed  by  the  ATRB. 

4.0  Award-Term  Processes 

a.  Available  Award-Term  Points.  The  earned  award-term  points  will  be  based  on  the 
contractor’s  performance  during  each  evaluation  period.  An  accumulation  of  positive  points  (e.g., 
+50,  +75,  or  +100)  is  required  for  a  one-year  term  extension,  while  an  accumulation  of  negative 
points  (e.g.,  -50,  -75,  or  -100)  results  in  a  one-year  reduction  in  the  contract  period.  It  is  important 
to  tailor  the  point  system  to  the  particular  acquisition. 

b.  Evaluation  Criteria.  If  the  CO  does  not  give  specific  written  notice  to  the  contractor  of  any 
change  to  the  evaluation  criteria  prior  to  the  start  of  a  new  evaluation  period,  use  the  same  criteria 
listed  for  the  preceding  period  in  the  following  award-term  evaluation  period.  Modifications  to  the 
plan  shall  take  effect  in  the  next  evaluation  period. 

c.  Interim  Evaluation  Process.  Conduct  interim  evaluations  at  least  every  six  months.  At  the 
discretion  of  the  TDO,  perform  interim  evaluations  more  frequently,  e.g.,  at  major  milestones.  The 
ATRB  recorder  notifies  ATRB  members  and  performance  monitors  14  calendar  days  before  the 
midpoint  of  the  evaluation  period.  Performance  monitors  submit  their  evaluation  reports  to  the 
ATRB  21  calendar  days  after  this  notification.  The  ATRB  determines  the  interim  evaluation  results 
and  notifies  the  contractor  of  the  strengths  and  weaknesses  for  the  current  evaluation  period.  The 
CO  may  also  issue  letters  at  any  other  time  when  it  is  deemed  necessary  to  highlight  areas  of 
government  concern. 

d.  End-of-Period Evaluations.  The  ATRB  recorder  notifies  ATRB  members  and  performance 
monitors  14  calendar  days  before  the  end  of  the  evaluation  period.  The  contractor  presents  its  self- 
assessment  to  the  CO  within  five  working  days  after  the  end  of  the  evaluation  period.  This  written 
assessment  of  the  contractor’s  performance  throughout  the  evaluation  period  may  also  contain  any 
information  that  could  be  reasonably  expected  to  assist  the  ATRB  in  evaluating  their  performance. 
The  self-assessment  may  not  exceed  25  pages.  Performance  monitors  submit  their  evaluation 
reports  to  the  ATRB  14  calendar  days  after  the  end  of  the  evaluation  period.  The  ATRB  forwards 
copies  to  the  eontractor.  The  performance  monitors  provide  oral  presentations  to  the  ATRB  21  days 
after  the  end  of  the  evaluation  period.  The  contractor  then  gets  an  opportunity  to  address  the 
performance  monitors’  evaluations.  The  ATRB  prepares  its  evaluation  report  and  recommendation 
regarding  earned  or  unearned  award-term  points.  The  ATRB  briefs  the  evaluation  report  and 
recommendation  to  the  TDO  within  30  calendar  days  after  the  end  of  the  evaluation  period.  The 
TDO  determines  the  overall  award-term  points  for  the  evaluation  period  within  45  calendar  days 
after  each  evaluation  period.  The  TDO’s  letter  informs  the  contractor  of  the  earned  award-term 
points  and  the  total  cumulative  points.  Upon  the  accumulation  of  sufficient  award-term  points,  the 
CO  issues  a  contract  modification  within  15  calendar  days  after  the  TDO’s  decision  is  made 
authorizing  an  award  extension  or  reduction  based  on  the  earned  or  unearned  award-term  points. 
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5.0  Award-Term  Plan  Change  Procedure 

Proposed  changes  to  the  awai  d-term  plan  will  be  bilateral.  If  either  party  desires  a  change  to  the  award- 
term  plan  and  a  mutual  agreement  cannot  be  reached,  the  original  award-term  plan  will  remain  in  effect. 

Award-Term  Clause 

In  addition  to  the  terms  set  forth  elsewhere  in  the  contract,  the  contractor  may  earn  an  extension 
or  reduction  to  the  contract  period  from  a  minimum  of  5  to  a  maximum  of  10  years  on  the  basis 
of  performance  during  the  evaluation  periods.  The  contractor  is  evaluated  during  the  first  year  of 
performance,  but  extensions  or  reductions  start  in  the  second  year.  If  scores  are  very  good  during 
Year  2,  the  contractor  earns  Year  4;  if  scores  are  very  good  in  Year  3,  the  contractor  earns  Year  5. 
In  Year  5,  the  contractor  must  earn  a  score  of  “excellent”  for  the  contract  period  to  be  extended 
beyond  Year  5.  Consistent  scores  of  “excellent”  during  succeeding  years  earn  contract  period 
extensions  up  to  a  maximum  of  10  years. 

You  may  reduce  the  contract  period  on  the  basis  of  the  contractor’s  performance  against  the 
stated  performance  parameters.  Award  or  deduct  points  during  each  year  of  the  contract  on  the 
basis  of  how  the  contractor  has  performed  against  the  predetermined  criteria.  Extend  or  reduce 
the  contract  period  to  reflect  this  assessment. 

(a)  Award  Term.  The  award-term  concept  is  an  incentive  that  permits  extension  of  the 
contract  period  beyond  the  base  period  of  performance  for  superior  performance  or  reduction  of 

the  contract  period  of  performance  for  poor  performance. 

(b)  Term  Points.  Positive  or  negative  points  are  accumulated  during  each  evaluation  period 
on  the  basis  of  the  contractor’s  performance.  An  accumulation  of  positive  points  (e.g.,  -|-50,  +75, 
or +100)  is  required  for  a  one-year  term  extension,  and  an  accumulation  of  negative  points  (e.g., 
-50,  -75,  or  - 1 00)  results  in  a  one-year  reduction  in  the  contract  period. 

(c)  Monitoring  of  Performance.  Performance  monitors  continually  monitor  the  contractor’s 
performance  and  send  their  reports  to  the  ATRB.  The  ATRB  recommends  an  award  term  to  the 
TDO,  who  makes  the  final  decision  on  the  award-term  amount  on  the  basis  of  the  contractor’s 
performance  during  the  award-term  evaluation  period. 

(d)  Award-Term  Plan.  The  award-term  plan  specifies  the  evaluation  criteria,  the  associated 
points,  and  the  assoeiated  award-term  extensions  or  reductions. 

(e)  Modification  of  Award-Term  Plan.  Make  changes  to  the  award-term  plan  at  any  time 
during  contract  performance,  provided  that  both  parties  agree  to  them.  If  agreement  eannot  be 
reaehed  on  changes,  the  initial  award-term  plan  remains  in  effect. 

(f)  Self-Evaluation.  Within  5  working  days  after  the  end  of  each  award-term  evaluation 
period,  the  contractor  will  submit  a  brief  written  self-evaluation  of  its  performance  for  that  period 
to  the  CO.  This  self-evaluation  shall  be  limited  to  25  pages.  It  will  be  used  in  the  ATRB’s  evalu¬ 
ation  of  the  contractor’s  performance  during  this  period. 

(g)  Disputes.  The  TDO  makes  decisions  regarding  the  award  term.  These  decisions  include, 
but  are  not  limited  to,  the  amount  of  the  award  term  (if  any),  caleulation  of  the  award  term,  the 
supplier’s  entitlement  to  the  award  term,  and  the  nature  and  success  of  the  contractor  s  perfor¬ 
mance.  These  decisions  are  final  and  are  not  subject  to  dispute. 

(h)  Award-Term  Extension.  Modify  the  contract  period  to  reflect  the  TDO’s  decision.  The 
total  eontract  ordering  period,  including  extensions  under  this  clause,  will  not  exceed  10  years. 
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You  must  include  the  award-term  provision  in  the  solicitation  and  resulting  contract.  If  at  any 
time  the  contract  period  does  not  extend  more  than  two  years  from  the  TDO’s  decision,  the 
operation  of  the  award-term  provision  will  cease  and  the  ordering  period  will  not  extend  beyond 
the  term  set  at  that  time. 
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APPENDIX  J  -  WRIGHT  BROTHERS  PERFORMANCE-BASED 
SPECIFICATION 


SIGNAL  CORPS  SPECIFICATION,  NO.  486. 
ADVERTISEMENT  AND  SPECIFICATION  FOR  A  HEAVBER-THAN-AIR 

FLYING  MACHINE 


TO  THE  PUBLIC: 

Sealed  proposals,  in  duplicate,  will  be  received  at  this  office  until  12  o  clock  noon  on  February  1, 
1908,  on  behalf  of  the  Board  of  Ordnance  and  Fortification  for  furnishing  the  Signal  Corps  with  a 
heavier- than-air  flying  machine.  All  proposals  received  will  be  turned  over  to  the  Board  of  Ordnance 
and  Fortification  at  its  first  meeting  after  February  1  for  its  official  action. 

Persons  wishing  to  submit  proposals  under  this  specification  can  obtain  the  necessary  forms  and 
envelopes  by  application  to  the  Chief  Signal  Officer,  United  States  Army,  War  Department,  Washing¬ 
ton,  D.  C.  The  United  States  reserves  the  right  to  reject  any  and  all  proposals. 

Unless  the  bidders  are  also  the  manufacturers  of  the  flying  machine,  they  must  state  the  name  and 
place  of  the  maker. 

Preliminary. — This  specification  covers  the  construction  of  a  flying  machine  supported  entirely 
by  the  dynamic  reaction  of  the  atmosphere  and  having  no  gas  bag. 

Acceptance.  —  The  flying  machine  will  be  accepted  only  after  a  successful  trial  flight,  during 
which  it  will  comply  with  all  requirements  of  this  specification.  No  payments  on  account  will  be 
made  until  after  the  trial  flight  and  acceptance. 

Inspection.  —  The  Government  reserves  the  right  to  inspect  any  and  all  processes  of  manufacture. 

GENERAL  REQUIREMENTS. 

The  general  dimensions  of  the  flying  machine  will  be  determined  by  the  manufacturer,  subject  to  the 
following  conditions: 

1.  Bidders  must  submit  with  their  proposals  the  following: 

(a)  Drawings  to  scale  showing  the  general  dimensions  and  shape  of  the  flying  machine 
which  they  propose  to  build  under  this  specification. 

(b)  Statement  of  the  speed  for  which  it  is  designed. 

(c)  Statement  of  the  total  surface  areas  of  the  supporting  places. 

(d)  Statement  of  the  total  weight. 

(e)  Description  of  the  engine  which  will  be  used  for  motive  power. 

(f)  The  material  of  which  the  frame,  pieces,  and  propellers  will  be  constructed.  Plans 
received  will  not  be  shown  to  other  bidders. 
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2.  It  is  desirable  that  the  flying  machine  should  be  designed  so  that  it  may  be  quickly  and  easily 
assembled  and  taken  apart  and  packed  for  transportation  in  Army  wagons.  It  should  be  capable  of 
being  assembled  and  put  in  operating  condition  in  about  one  hour. 

3.  The  flying  machine  must  be  designed  to  carry  two  persons  having  a  combined  weight  of 
about  350  pounds,  also  sufficient  fuel  for  a  flight  of  125  miles. 

4.  The  flying  machine  should  be  designed  to  have  a  speed  of  at  least  forty  miles  per  hour  in  still 
air,  but  bidders  must  submit  quotations  in  their  proposals  for  cost  depending  upon  the  speed  attained 
during  the  trial  flight,  according  to  the  following  scale: 

40  miles  per  hour,  100  percent 

39  miles  per  hour,  90  percent 

38  miles  per  hour,  80  percent 

37  miles  per  hour,  70  percent 

36  miles  per  hour,  60  percent 

Less  than  35  miles  per  hour,  rejected. 

41  miles  per  hour,  1 10  percent 

42  miles  per  hour,  120  percent 

43  miles  per  hour,  130  percent 

44  miles  per  hour,  140  percent 

5.  The  speed  accomplished  during  the  trial  flight  will  be  determined  by  taking  an  average  of 
the  time  over  a  measured  course  of  more  than  five  miles,  against  and  with  the  wind.  The  time  will  be 
taken  by  a  flying  start,  passing  the  starting  point  at  full  speed  at  both  ends  of  the  course.  This  test  is 
subject  to  additional  details  as  the  Chief  Signal  Officer  of  the  Army  may  prescribe  at  the  time. 

6.  Before  acceptance  a  trial  endurance  flight  will  be  required  of  at  least  one  hour  during  which 
time  the  flying  machine  must  remain  continuously  in  the  air  without  landing.  It  shall  return  to  the 
starting  point  and  land  without  any  damage  that  would  prevent  it  immediately  starting  upon  another 
flight.  During  this  trial  flight  of  one  hour,  it  must  be  steered  in  all  directions  without  difficulty  and  at 
all  time  under  perfect  control  and  equilibrium. 

7.  Three  trials  will  be  allowed  for  speed  as  provided  for  in  paragraph  4  and  5.  Three  trials  for 
endurance  as  provided  for  in  paragraph  6,  and  both  tests  must  be  completed  within  a  period  of  thirty 
days  from  the  date  of  delivery.  The  expense  of  the  tests  to  be  borne  by  the  manufacturer.  The  place  of 
delivery  to  the  Government  and  trial  flights  will  be  at  Fort  Myer,  Virginia. 

8.  It  should  be  so  designed  as  to  serve  in  any  country  which  may  be  encountered  in  field 
service.  The  starting  device  must  be  simple  and  transportable.  It  should  also  land  in  a  field  without 
requiring  a  specially  prepared  spot  and  without  damaging  its  structure. 

9.  It  should  be  provided  with  same  device  to  permit  a  safe  decent  in  case  of  an  accident  to  the 
propelling  machinery. 

10.  It  should  be  sufficiently  simple  in  its  construction  and  operation  to  permit  an  intelligent 
man  to  become  proficient  in  its  use  within  a  reasonable  length  of  time. 
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1 1 .  Bidders  must  furnish  evidence  that  the  Government  of  the  United  States  has  the  lawful  right 
to  use  all  potential  devices  or  appurtenances  which  may  be  a  part  of  the  flying  machine,  and  that  the 
manufacturers  of  the  flying  machine  are  authorized  to  convey  the  same  to  the  Government.  This 
refers  to  the  unrestricted  right  to  use  the  flying  machine  sold  to  the  Government,  but  does  not  contem¬ 
plate  the  exclusive  purchase  of  patent  rights  for  duplicating  the  flying  machine. 

12.  Bidders  will  be  required  to  furnish  with  their  proposal  a  certified  check  amounting  to  ten 
percent  of  the  price  stated  for  the  40-mile  speed.  Upon  making  the  award  for  this  flying  machine,  those 
certified  checks  will  be  returned  to  the  bidders,  and  the  successful  bidder  will  be  required  to  furnish  a 
bond,  according  to  Army  Regulations,  of  the  amount  equal  to  the  price  stated  for  the  40-mile  speed. 

13.  The  price  quoted  in  proposals  must  be  understood  to  include  the  instruction  of  two  men  in 
the  handling  and  operation  of  this  flying  machine.  No  extra  charge  for  this  service  will  be  allowed. 

14.  Bidders  must  state  the  time  which  will  be  required  after  receipt  of  order. 

JAMES  ALLEN, 

Brigadier  General, 

Chief  Signal  Officer  of  the  Army. 


SIGNAL  OFFICE, 

WASHINGTON,  D.  C.,  December  23,  1907. 


FORM  No.  18. 

Signal  Corps,  United  States  Army. 

THESE  ARTICLES  OF  AGREEMENT  entered  into  this  tenth  day  of  February  nineteen 
hundred  and  eisht  .  between  Chas.  S.  Wallace,  Captain,  Signal  Corps,  United  States  Army, 
of  the  first  part  and 

Wilbur  and  Orville  Wright,  trading  as  Wright  Brothers, 
of  1 127  West  Third  Street,  Dayton, 

in  the  county  of  Montgomery  State  of  Ohio  of  the  second  part. 

WITNESSETH,  that  in  conformity  with  copy  of  the  advertisement,  specifications,  and  proposal 

hereto  attached,  and  which,  in  so  far  as  they  relate  to  this  contract,  form  a  part  of  it,  the  said _ Chas. 

S.  Wallace.  Cantain.  Signal  Corps,  United  States  Army,  for  and  in  behalf  of  the  United  States  of 
America,  and  the  said  Wrieht  Brothers  (hereinafter  designated  as  the  contractor)  do  covenant 
and  agree,  to  and  with  each  other,  as  follows,  viz: 

Article  I.  That  the  said  contractor  shall  manufacture  for  and  deliver  to  the  United  States  of  America, 
one  (1)  heavier-than-air  flying  machine,  in  accordance  with  Signal  Corps  Specification  No.  486, 
dated  December  15, 1907. 


46 


Article  II.  That  the  deliverance  of  the  supplies  and  materials  herein  contracted  for  shall  be  made 
in  the  manner,  numbers,  or  quantities,  and  for  each  number  or  quantity,  on  or  before  the  date  specified 
therefor,  as  follows,  viz: 

That  complete  delivery  shall  be  made  on  or  before  August  28, 1908. 

Article  III.  All  supplies  and  materials  furnished  and  work  done  under  this  contract  shall,  before 
being  accepted,  be  subject  to  a  rigid  inspection  by  an  inspector  appointed  on  the  part  of  the  Govern¬ 
ment,  and  such  as  do  not  conform  to  the  specifications  set  forth  in  this  contract  shall  be  rejected.  The 
decision  of  the  Chief  Signal  Officer,  United  States  Army,  as  to  quality  and  quantity  shall  be  final. 

Article  IV.  That  for  and  in  consideration  of  the  faithful  performance  of  the  stipulations  of  this 
contract,  the  contractor  shall  be  paid  at  the  office  of  the  Chief  Si  mal  Officer  of  the  Army,  at  Washine- 
ton.  D.C  for  all  supplies  and  materials  delivered  in  conformity  with  the  requirements  of  this  contract, 
on  or  before  the  dates  above  specified  (Article  II,  supra)  and  accepted,  the  following  prices,  viz: 

One  (1)  heavier-than-air  flying  machine  at  a  total  cost  of  twenty-five  thousand  (25,000)  dollars  to 
be  paid  as  soon  as  practicable  after  the  acceptance  of  the  same,  in  funds  furnished  by  the  United 

States  for  the  purpose,  reserving percent  from  each  payment  until  final  settlement,  on  completion 

of  the  contract  or  otherwise. 

Article  V.  It  is  further  agreed  that  for  all  supplies  and  materials  which  shall  not  be  delivered  in 
conformity  with  the  requirements  of  this  contract  on  or  before  the  dates  prescribed  therefor  in  Article 
II,  above,  but  which  shall  be  subsequently  delivered  and  accepted,  the  prices  shall  be  as  follows: 

Article  VI.  That  in  case  of  the  failure  of  the  said  contractor  to  perform  the  stipulations  of  this  contract 
within  the  time  and  in  the  manner  specified  above.  Articles  I  to  III,  inclusive,  the  said  party  of  the  first 
part  may,  instead  of  writing  further  for  deliveries  under  the  provisions  of  the  preceding  article,  supply  the 
deficiency  by  purchase  in  open  market  or  otherwise,  at  such  place  as  may  be  selected  (the  articles  so 
procured  to  be  the  kind  herein  specified,  as  near  as  practicable);  and  the  said  contractor  shall  be  charged 
with  the  increased  cost  of  the  supplies  and  materials  so  purchased  over  what  they  would  have  cost  if 
delivered  by  the  contractor  on  the  date  they  were  received  under  such  open-market  purchase. 

Article  Vn.  It  is  further  agreed  by  and  between  the  parties  hereto  that  until  final  inspection  and 
acceptance  of,  and  payment  for,  all  of  the  supplies  and  materials  and  work  herein  provided  for,  no  prior 
inspection,  payment,  or  act  is  to  be  construed  as  a  waiver  of  the  right  of  the  party  of  the  first  part  to  reject 
any  defective  articles  or  supplies  or  to  require  the  fulfillment  of  any  of  the  terms  of  the  contract. 

Article  VIII.  The  contractor  further  agrees  to  hold  and  save  the  United  States  harmless  from  and 
against  all  and  every  demand,  or  demands,  of  any  nature  or  kind  for,  or  on  account  of,  the  use  of  any 
patented  invention,  article,  or  process  included  in  the  materials  hereby  agreed  to  be  furnished  and 
work  to  be  done  under  this  contract. 

Article  IX.  Neither  this  contract  nor  any  interest  herein  shall  be  transferred  to  any  other  party  or 
parities,  and  in  case  of  such  transfer  the  United  States  may  refuse  to  carry  out  this  contract  either  with 
the  transferor  or  the  transferee,  but  all  rights  of  action  for  any  breach  of  this  contract  by  said  contractor 
are  reserved  to  the  United  States. 
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Article  X.  No  Member  of  or  Delegate  to  Congress,  nor  any  person  belonging  to,  or  employed  in, 
the  military  service  of  the  United  States,  is  or  shall  be  admitted  to  any  share  or  part  of  this  contract,  or 
to  any  benefit  which  may  arise  therefrom.* 

Article  XL  That  it  is  expressly  agreed  and  understood  that  this  contract  shall  be  noneffective  until 
an  appropriation  adequate  to  its  fulfillment  is  made  by  Congress  and  is  available. 

Article  XII.  That  this  contract  shall  be  subject  to  approval  of  the  Chief  Signal  Officer,  United 
States  Army. 

IN  WITNESS  WHEREOF  the  parties  aforesaid  have  hereunto  placed  their  hands  the  date  first 
hereinbefore  written. 

WITNESSES; 
as  to 

Captain,  Signal  Corps,  U.S.  Army 
as  to 

Wright  Brothers  by  Orville  Wright 


APPROVED:  _ ,  190 


Brigadier  General, 

Chief  Signal  Officer  of  the  Army. 


*Here  add  to  any  contract  made  with  an  incorporated  company  for  its  general  benefit  the  following 
words,  viz:  “But  this  stipulation,  so  far  as  it  relates  to  Members  or  Delegates  of  Congress,  is  not  to  be 
construed  to  extend  to  this  contract.”  See  section  §780,  Revised  Statutes. 


This  material  has  been  prepared  for  instructional  purposes  only.  Request  for  reproduction  should  be 
addressed  to  the  Commandant,  United  States  Army  Logistics  Management  Center,  Fort  Lee,  Virginia. 
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APPENDIX  K-  REFERENCES  AND  WEBSITES 


http://www.acq.osd.mil/ar/doc/ganslerpbsa.pdf 
Department  of  Defense  policy  on  PBSA,  5  April  2000 


http://web2.deskbook.osd.mii/defauIt.asp 

Defense  Acquisition  Deskbook 


http://farsite.hill.af.mil/VFFARl.HTM 

Federal  Acquisition  Regulation  (FAR) 


http://www.safaq.hq.af.mil/contracting/toolkit/part37/ 

Air  Force  Contracting  Toolkit  on  Services 


http  ://acqnet.sarda.army.mil/ 

Army  Acquisition  Website 


http://www.acq-ref.navy.mil/ 

Navy  Acquisition  Reform 


http://www.dodig.osd.mil/audit/reports/OOreport.htm 

Office  of  the  Inspector  General,  Audit  Report  on  Contracts  for  Professional,  Administrative  and 
Management  Support  Services,  10  March  2000,  Report  No.  D-2000-100 


http://www.arnet.gov/Library/OFPP/BestPractices/ 

Best  Practices  for  Performance-based  Contracting,  Best  Practices,  Final  Edition,  October  1998 


http://www.pr.doe.gov/9808atc.htm 

Department  of  Energy,  Performance-based  Contracting  Guide,  June  1998 


http://www.ogam2000.com/acquisition 

Health  and  Human  Services  (HHS)  Performance-based  Contracting  Desk  Reference 
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